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ABSTRACT 

We present weak lensing shear catalogues for 139 square degrees of data taken during the 
Science Verification (S V) time for the new Dark Energy Camera (DECam) being used for the 
Dark Energy Survey (DES). We describe our object selection, point spread function estimation 
and shear measurement procedures using two independent shear pipelines, 1m3SHAPE and 
NGMIX, which produce catalogues of 2.12 million and 3.44 million galaxies respectively. We 
detail a set of null tests for the shear measurements and find that they pass the requirements 
for systematic errors at the level necessary for weak lensing science applications using the SV 
data. We also discuss some of the planned algorithmic improvements that will be necessary 
to produce sufficiently accurate shear catalogues for the full 5-year DES, which is expected 
to cover 5000 square degrees. 


Key words: gravitational lensing: weak - cosmology: observations - surveys - catalogues - 
methods: data analysis - techniques: image processing 


1 INTRODUCTION 

Weak gravitational lensing provides a powerful statistical tool for 
studying the distribution of mass in the Universe. Light traveling 
from distant galaxies to Earth is deflected by the gravitational field 
of mass concentrations along the path. This deflection distorts the 
observed light distribution of galaxies, and when this distortion is 
very small, stretching the surface brightness profile by of order a 
few percent or less, it is referred to as “weak lensing”. 

The weak lensing distortion includes both a stretching compo¬ 
nent called “shear” and a dilation component called “convergence”. 
Here we focus on the shear. The observed shear field can be used 
to make maps of the matter in the universe, uncover the mass pro¬ 
files of galaxies and clusters of galaxies, and even test theoretical 
models of dark energy. 

In order to reach its full potential as a probe of dark matter and 
dark energy, shear measurement must be extremely accurate. Each 
galaxy is typically stretched by about 2%, whereas the intrinsic un¬ 
known ellipticity of the galaxy before being lensed is an order of 
magnitude larger. This “shape noise” constitutes the primary sta¬ 
tistical uncertainty for weak lensing measurements. Nevertheless, 
by measuring the shapes of millions of galaxies, the Dark Energy 
Survey (DES) and other current surveys can expect to make precise 
measurements of the mean shear with fractional statistical uncer¬ 
tainties as low as 1%. Euture surveys may reach 0.1%. This implies 
that systematic errors (i.e. biases) in the shape measurements need 
to be controlled at a level approximately 3 orders of magnitude 
smaller than the shape noise on each measurement. 

There are many potential sources of systematic error that 
can bias the shape measurements used for estimating shears. The 
galaxy images are blurred and smeared when the photons pass 
through the atmosphere, the telescope optics, and the detector, lead¬ 
ing to a spatially and temporally variable point-spread function 
(PSF). The images are stretched by distortion from the telescope 
and sometimes by features of the detector. The images are pixel- 
lated and have various sources of noise. Detector defects, cosmic 
rays, satellite trails, and other artefacts in the data can lead to some 
pixels not being used, and measurement algorithms must deal prop¬ 
erly with this “missing data”. Flux from nearby galaxies or stars 
can obfuscate the determination of the observed intensity profile. 
All of these phenomena must be included in the analysis at very 
high accuracy if systematic uncertainties are to be sub-dominant to 
statistical uncertainties. 


Previous studies have taken a range of approaches to mea¬ 
suring galaxy shapes, typically falling into one of two categories. 
Moments-based methods (e.g. Kaiser et al. 1995; Rhodes et al. 
2000; Melchior et al. 2011) involve measuring second and higher- 
order moments of the galaxy and the PSF. Model-fitting meth¬ 
ods (e.g. Massey & Refregier 2005; Nakajima & Bernstein 2007; 
Miller et al. 2013) involve fitting a PSF-convolved galaxy model 
to the data. A number of blind challenges of shear measurements 
have been carried out to assess progress in a uniform way across 
the international shear measurement community: the Shear TEsting 
Programme (STEP Heymans et al. 2006; Massey et al. 2007) and 
the GRavitational lEnsing Accuracy Testing (GREAT) Challenges 
(Bridle et al. 2009, 2010; Kitching et al. 2010, 2012; Mandelbaum 
et al. 2014, 2015). The wide variety of shear measurement meth¬ 
ods and their performance on these benchmarks are summarized 
there. The two shear algorithms presented in this work, IM3SHAPE 
(Zuntz et al. 2013), and NGMIX, are both of the model-fitting vari¬ 
ety (cf. §7). 

Most shear measurement methods are biased in the low 
signal-to-noise (S/N) regime, where the impact of pixel noise on 
the shape measurement of each galaxy becomes significant. This 
“noise bias” effect was first discussed in Bernstein & Jarvis (2002) 
and Hirata et al. (2004), and was found to be the most significant of 
the effects studied in the GREAT08 Challenge (Bridle et al. 2009, 
2010). It was derived analytically for maximum-likelihood meth¬ 
ods in Refregier et al. (2012), in the context of direct estimation in 
Melchior & Viola (2012), and quantified in the context of future 
surveys in Kacprzak et al. (2012). 

Complex galaxy morphologies can also bias shear measure¬ 
ments (Massey et al. 2007; Lewis 2009; Voigt & Bridle 2010; Bern¬ 
stein 2010; Melchior et al. 2010; Zhang & Komatsu 2011). This 
“model bias” can arise even for simple galaxy profiles if the model 
being used does not match reality. Model bias was found to be 
around 1% for bulge-l-disc model fitting methods, and the interplay 
with noise bias was found to be small (Kacprzak et al. 2014). The 
GREAT3 challenge (Mandelbaum et al. 2014, 2015) included real¬ 
istic galaxy morphologies, and those authors found that the mean 
model bias was ~ 1% for a wide range of methods. The Fourier 
Domain Nulling approach (Bernstein 2010) provides a potential 
solution to this problem, which may be able to avoid model bias 
altogether. 

One strategy to account for these biases is to apply a multi- 
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plicative correction factor calibrated from image simulations. This 
can take the form of a single constant bias correction applied to 
all galaxies (e.g. Schrabback et al. 2007), or it can vary according 
to galaxy properties such as the signal-to-noise ratio (Schrabback 
et al. 2010; Gruen et al. 2013) and size (von der Linden et al. 2014). 
For the IM3SHAPE shear measurements, we calibrate biases as a 
function of both of these parameters, as done by Kacprzak et al. 
(2012). A significant improvement in the current analysis lies in 
our modeling of additive systematic errors as proportional to PSF 
ellipticity, which we also apply as a calibration (cf. §7.3.2). 

A different strategy to account for noise bias (although not 
model bias) is to include the known distribution of intrinsic galaxy 
shapes as Bayesian prior information and fully sample the poste¬ 
rior likelihood surface. Miller et al. (2007) proposed a first order 
approximation to this, and a more rigorous treatment was given 
by Bernstein & Armstrong (2014). For the NGMIX shear measure¬ 
ments, we follow the approach of Miller et al. (2007) (cf. §7.4.3). 

Each part of the sky in a weak lensing survey is generally ob¬ 
served multiple times. Most commonly, the shape measurements 
are made on coadded images of these multiple exposures (e.g. 
Wittman et al. 2000; Van Waerbeke et al. 2000; Fleymans et al. 
2005; Leauthaud et al. 2007; Fu et al. 2008). While coadded im¬ 
ages reduce the total data volume, making data handling easier, 
differences in the PSFs between the epochs complicate the mod¬ 
eling of the coadded PSF and often introduce spurious effects that 
are problematic for the most sensitive shear probes. Multi-epoch 
methods (Tyson et al. 2008; Bosch 2011; Miller et al. 2013) in¬ 
stead simultaneously use all individual exposures of a galaxy with 
the corresponding single-epoch PSF models and weights, thereby 
avoiding these problems. 

The current state-of-the-art weak lensing shear measurement 
comes from the Canada-France-FIawaii Telescope Lensing Survey 
(CFHTLenS; Heymans et al. 2012b), which observed 154 square 
degrees of sky and measured 7.6 million galaxy shapes. They dis¬ 
covered that the previous CFHTLenS analysis (Fu et al. 2008), us¬ 
ing coadd images, had significant systematic errors and that switch¬ 
ing to a multi-epoch method (Miller et al. 2013) was superior. We 
use similar multi-epoch algorithms in this work (cf. §7.1). 

For removing problematic data, the CFHTLenS analysis 
trimmed the survey area to only those fields in which the shape 
catalogues passed certain systematic tests. We use a somewhat dif¬ 
ferent strategy in our analysis. We blacklist single-epoch images 
that fail tests of the image quality, the astrometric solution, or the 
PSF model, and exclude them from the multi-epoch fitting process 
(cf. §5.1). 

In this paper we present the shear catalogue for the DES Sci¬ 
ence Verification (SV) data, described in §2. We derive require¬ 
ments for our systematic uncertainties in §3. The PSF model is de¬ 
scribed and tested in §4. To facilitate multi-epoch shear measure¬ 
ments, we developed Multi-Epoch Data Structures (MEDS), which 
we describe in §5. Two sets of simulations that we used for calibra¬ 
tion and testing are presented in §6. We present our two shear es¬ 
timation codes, IM3shape and NGMIX in §7. Then we submit our 
catalogues to a suite of null tests, described in §8, which constitutes 
the main results of this paper. Einally, we describe our final shear 
catalogues in §9 and conclude in §10. Appendices provide more 
information on the data structures and catalogue flags. A flowchart 
outlining the main stages in the production of the shear catalogues 
is shown in Figure 1 . 


2 DATA 

The Dark Energy Camera (DECam; Flaugher et al. 2015; Diehl 
2012; Honscheid et al. 2012) was installed on the 4m Victor M. 
Blanco Telescope at the Cerro Tololo Inter-American Observatory 
(CTIO) in Chile from June, 2011, to September, 2012 (Diehl et al. 
2014). The first light ceremony was September 12, 2012. 

DECam holds sixty-two 2048 x 4096 science CCDs, four 
2048 X 2048 guider CCDs, and eight 2048 x 2048 focus and 
alignment CCDs, for a total of 570 megapixels covering a roughly 
hexagonal footprint. The CCDs were fabricated at Teledyne Dalsa^, 
further processed by Lawrence Berkeley National Laboratory 
(LBNL), and assembled and tested at Fermilab^. Each CCD is 250 
microns thick and fully depleted, with two amplifiers per CCD. 

The DECam field of view has a diameter of 2.2 degrees on 
the sky. Unfortunately, one the 62 science CCDs was damaged dur¬ 
ing commissioning, so we have only 61 working CCDs^. The total 
usable footprint of an exposure, excluding the gaps between the 
CCDs, totals 2.7 square degrees. Five filters are used during nor¬ 
mal survey operations, g, r, i, z, Y, exchanged using an automated 
shutter-filter system (Tarle et al. 2010). 

The Dark Energy Survey (DES) officially started taking sur¬ 
vey data in August, 2013 (Diehl et al. 2014). It will cover about 
5000 square degrees in the South Galactic Cap region, with ~10 
visits per field in the g, r, i and 2 bands (two visits per year), 
for a lOcr limiting magnitude of about 24.1 in the i band. In addi¬ 
tion to the main survey, the DES supernova survey contains smaller 
patches optimized for time-domain science, which are visited more 
often, and which are useful as a deeper dataset observed with the 
same instrument. 

Before the start of the main survey, a small Science Verifica¬ 
tion (SV) survey was conducted from November 2012 to Febru¬ 
ary 2013. The strategy was to observe the SV area at 10 differ¬ 
ent epochs, mimicking the number of visits and total image depth 
planned for the full 5-year DES survey. The dither pattern matches 
that of the main survey, which uses large dithers to minimize the 
impact of any systematic errors related to the location on the field 
of view. Each tiling is typically observed on different nights to vary 
the observing conditions as much as possible. Significant depth 
variations exist in the SV data due to weather, issues with the tele¬ 
scope, and no data quality checks to ensure uniformity (cf. Leistedt 
etal. 2015). 

Eor the current study we restricted our measurements to the 
largest portion of the SV area, known as SPT-East (SPT-E for 
short), an area of approximately 139 square degrees contained 
within the eastern part of the region observed by the South Pole 
Telescope (SPT; Carlstrom et al. 2011). 

The SV data were reduced by the DES Data Management 
(DESDM) system (Mohr et al. 2012; Desai et al. 2012), result¬ 
ing in calibrated and background-subtracted images. Catalogues 
were produced using the software package Source Extractor (SEx- 
TRACTOR; Bertin & Arnouts 1996; Berlin 201 1). The point spread 
function was characterized using the PSFEx package (Bertin 2011; 
for more details, see §4). 

On a set of pre-defined areas of sky, all overlapping single- 


^ https://www.teledynedalsa.com 

^ Fermilab is operated by Fermi Research Alliance, LLC under Contract 
No. De-AC02-07CHl 1359 with the United States Department of Energy. 

® One additional science CCD failed in the first year of the DES main sur¬ 
vey (Diehl et al. 2014), but it was still functional for the work presented 
here. 
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Figure 1. A flowchart showing the main stages in the production of the shear catalogues. The items inside the blue bracket are done by the weak lensing group 
in DES and are the principal subject of this paper. 


epoch images were registered and combined into a coadd image 
using the SCAMP and SWarp packages (Bertin et al. 2002; Bertin 
2006). 

For weak lensing we used these coadd images only for object 
detection, deblending, fluxes (for use in photometric redshift mea¬ 
surements, see Sanchez et al. 2014; Bonnett et al. 2015), and for the 
detailed informational flags which were important for determining 
a good set of galaxies to use for shear measurement. 

In contrast to previous work on DES data by Melchior et al. 
(2015), we performed object shape measurement directly on all 
available single-epoch images in which an object was observed, us¬ 
ing multi-epoch fitting techniques. See §5 for more details of how 
we repackaged the data for multi-epoch fitting and §7.1 for a de¬ 
scription of the multi-epoch measurement process. 

2.1 Object Catalogue 

The starting point for our object catalogue was the “SVAl Gold 
Catalogue” which excludes regions of the data that were found 
to be problematic in some way, due to imaging artefacts, scattered 
light, failed observations, etc. The selection criteria for the Gold 
Catalogue included the following: 

• Required object to have been observed at least once in each of 
the g, r, i, and a bands. 

• Required Declination to be north of 61° 5 to avoid the Large 
Magellanic Cloud and R Doradus, where the photometric calibra¬ 
tion was found to have severe problems. 

• Removed regions with a high density of objects with “crazy 
colours”, i.e. those with any of the following: g — r < —1, g — r > 
4, i—z < —l,ori—z > 4. Such regions are usually due to satellite 
trails, ghosts, scattered light, etc. 

• Removed regions with a density less than 3cr below the mean 
density. 

• Removed regions near bright stars. We eliminated a circular 
region around all stars detected in the 2-micron All Sky Survey 

^ http;//des.ncsa.Illinois . edu/releases/sval 


(2MASS; Skrutskie et al. 2006) brighter than Jm = 12 with a 
mask radius of r = (— IOJm + 150) arcseconds up to a maximum 
radius of 120 arcseconds. 

• Removed regions with a concentration of objects with large 
centroid shifts between bandpasses. Some of these objects are 
just dropout galaxies or large galaxies with complex, wavelength- 
dependent substructure, but many are due to scattered light, ghosts, 
satellite trails, etc. 25% of such objects fall into 4% of the total 
area, so we removed all objects in that 4% on the assumption that 
the other nearby objects probably have corrupted shapes and pho¬ 
tometry. 

The full SPT-E area observed during SV totals 163 square de¬ 
grees. Applying the above selection criteria brings this down to 148 
square degrees for the Gold Catalogue. 

The selection criteria listed above removed galaxies in a non- 
random way that varied across the sky. We characterized this se¬ 
lection using a geometrical “mask”, implemented as a HEALPIX 
map (Gorski et al. 2005). The HEALPIX map for the DES SPT-E 
region is shown in Figure 2. The white background represents the 
Gold Catalogue area. The coloured intensity represents the galaxy 
number density in the NGMIX catalogue (cf. §7.4). 

The region used for the weak lensing analysis is somewhat 
smaller than the full Gold Catalogue region, because we addition¬ 
ally excluded CCD images with poor astrometric solutions (cf. 
§2.3), poor PSF solutions (cf. §4.2), and blacklisted CCDs contain¬ 
ing bright stars, ghosts, airplanes etc. (cf. §5.1). The astrometric 
cuts in particular removed regions near the edge, since the solu¬ 
tions were poorly constrained there, resulting in a final area for the 
shear catalogues of 139 square degrees. The intensity map for the 
IM3shape catalogue (cf. §7.3) looks qualitatively similar, although 
it is about 40% shallower (cf. §9.3). 


2.2 Galaxy Selection 

The preliminary galaxy selection was performed using standard 
SExtractor outputs from the i-band detections in the Gold Cat¬ 
alogue. The selection, in pseudo-code, was 
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Figure 2. A HEALPIX map of the SPT-E region. The white background 
shows the full “Gold” area. The colours show the galaxy density in the 
NGMIX shear catalogue. (The map for IM3 shape is qualitatively similar', 
although about 40% shallower.) The map has HEALPIX resolution nside 
= 512. 


bright_test = CLASS_STAR >0.3 
AND MAG_ADTO <18.0 
locus_test = SPREAD_MODEL + 

3*SPREADERR_MODEL < 0.003 
faint_psf_test = MAG_PSF >30.0 
AND MAG_AUTO <21.0 

galaxies = NOT bright_test 
AND NOT locus_test 
AND NOT faint_psf_test 

Within DES, this is called the “Modest Classification” 
scheme. Bright stars were identified by the standard SEXTRACTOR 
classifier (bright_test). Fainter objects were considered stars if 
they were near the stellar locus in the spread_model measure, in¬ 
troduced by Desai et al. (2012), which uses a model of the local 
PSF to quantify the difference between PSF-like objects and re¬ 
solved objects (locus_test; see also Bouy et al. 2013). 

Objects whose best estimate of the total magnitude is much 
brighter than their PSF magnitude (faint_psf_test) are often 
spurious detections and were considered “junk” in this classifica¬ 
tion. Our initial galaxy selection then included every object not 
classified as either a star or junk by this scheme. 

Many faint stars and spurious detections remained in the cata¬ 
log at this stage. Later, further selection criteria, described in §9.1, 
were applied based on measurements from the shear pipelines. The 
initial selection was not intended to produce an accurate galaxy cat¬ 
alogue, but rather to produce a superset of the objects that would 
eventually be trimmed based on more stringent selection criteria. 
All objects in this preliminary galaxy catalogue were processed by 
both shear measurement algorithms (cf. §7). 


2.3 Astrometry 

For each CCD image we must establish an astrometric solution, i.e. 
a map from pixel coordinates (a:, y) to celestial coordinates (9, 0), 
known as the World Coordinate System (WCS). Since the determi¬ 
nation of galaxy shapes is done by a simultaneous fit to the pixel 
data for all single-epoch exposures covering the galaxy, any mis¬ 
registration of the exposures will introduce spurious shear signals 
into the inferred galaxy shapes and sizes. 

We found that the astrometric solutions provided by DESDM 
were not sufficiently accurate for our needs. They included misreg¬ 
istrations of more than 150 milliarcseconds on some CCDs, which 
induced unacceptably high systematic errors in the galaxy shapes. 
Here we describe the process we used to improve these solutions to 
the WCS. 

Astrometric solutions for the SV exposures were assumed to 
take the form 

P{e,<i,) = E{C{x,y)), ( 2 . 1 ) 

where P is a gnomonic projection from the (curved) sky on to a 
planar coordinate system, using a chosen field coordinate for the 
pole of the projection; E is an affine transformation chosen to be 
distinct for each CCD image of each exposure; and C is a cubic 
polynomial mapping that is common to all exposures in a given 
filter with a given CCD. In the nomenclature of the SCAMP code®, 
C is the “instrument” solution, and E is the “exposure” solution. 

The instrument solution C was derived as follows. We took 
a series of « 20 exposures of a rich star field in succession, with 
the telescope displaced by angles ranging from 10 arcseconds up 
to the field of view of the camera. Coordinates of stars were deter¬ 
mined in the pixel coordinates of each exposure, and we adjusted 
the parameters of the map in equation 2.1 to minimize the internal 
disagreement between sky coordinates of all the observations of 
each star. The solution also minimized the discrepancies between 
the positions of stars in the 2MASS (Skrutskie et al. 2006) cata¬ 
logue and our measurements of these stars, thereby anchoring the 
absolute pointing and scale of our astrometric maps. 

All 20 coefficients of the cubic polynomial C were left free 
for each of the 61 functional CCDs (cf. Diehl et al. 2014; Flaugher 
et al. 2015). While fitting the star field data, we forced all CCDs in 
a given exposure to share a common affine map E, so there were 6 
additional free parameters in the fit for each exposure. The instru¬ 
ment maps C derived in this way were assumed to apply to all SV 
exposures taken with the same CCD in the same filter. The process 
was repeated for each of the g, r, i, z, Y filters. 

Repeating the above “star flat” procedure every few months re¬ 
vealed small changes in the astrometric map, consistent with rigid 
motion of some CCDs relative to the others at a level of « 10 mil¬ 
liarcseconds, probably occurring when the camera was cycled to 
room temperature for occasional engineering tasks. 

To account for these small shifts, we determined an indepen¬ 
dent E function (6 degrees of freedom) for each CCD image in the 
SV data in another round of fitting. In this second stage we mini¬ 
mized the disagreements between positions reported for all CCDs 
that contribute to each DES coadd image. The coefficients of the 
affine transformations E were allowed to float, but the higher-order 
polynomials C were held fixed at the values determined from the 
star field data. These solutions again minimized residuals with re¬ 
spect to matching sources from the 2MASS catalogue in order to 
fix the absolute position on the sky. 

® http : //WWW . astromatic . net/software/scamp 
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Note that the principal effects of differential chromatic refrac¬ 
tion (DCR) are a shift and a shear along the direction toward zenith, 
which are both properly included as part of the affine transforma¬ 
tion E for each CCD. We did not, however, make any attempt to 
address the intra-band chromatic effects related to DCR (cf. Plazas 
& Bernstein 2012; Meyers & Burchat 2015). 

The RMS disagreement between sky positions of bright stars 
inferred from distinct DES exposures are consistent with errors in 
the astrometric maps of 10-20 milliarcseconds RMS in each coor¬ 
dinate. We found these errors to be coherent over arcminute scales 
in a given exposure, but were uncorrelated between distinct expo¬ 
sures. We interpret this to mean the remaining relative astromet¬ 
ric errors are dominated by stochastic atmospheric distortions (cf. 
Heymans et al. 2012a). Indeed, equation 8 of Bouy et al. (2013) 
predicts an RMS astrometric residual due to the atmosphere of or¬ 
der 10 milliarcseconds for our field of view and exposure time. 

We found some remaining astrometric errors that were coher¬ 
ent over time and correlated with position on the detector array, 
which are consistent with small components of the electric fields 
transverse to the surface of the CCD in some places (Plazas et al. 
2014). These residuals are at the few milliarcsecond level, which is 
small enough to be irrelevant for SV data reductions. 


first proposed by Heymans et al. (2006), uses a first-order expan¬ 
sion of the form, 

(e) = (1 -I- m)gtrue + aepsF -b c, (3.4) 

where gtme denotes the value that would be obtained from an ideal 
error-free shape estimator, m quantifies the multiplicative error, a 
measures the leakage of the PSF shape into the galaxy shapes, and 
c represents other sources of additive error. 

Note that m can in principle be different for each of the two 
components ei and 62 . However, we find in practice that the two 
coefficients are generally very close to equal when they can be mea¬ 
sured separately, so we simply take m to be a single real value here. 
Similarly, a could in principle have up to 4 components if the leak¬ 
age were anisotropic and involved cross terms®, but we do not see 
evidence for anything beyond a real-valued a in practice. 

The leakage term aepsF is commonly (e.g. Heymans et al. 
2006) implicitly folded into the general additive error term, c, but 
we have found it useful to retain it explicitly, since PSF leakage can 
be one of the more difficult additive errors to correct. Furthermore, 
Mandelbaum et al. (2015) found that the additive systematic errors 
for essentially all of the methods submitted to the GREAT3 chal¬ 
lenge were well-described by aCpsF, which motivates us to include 
it as an explicit term in equation 3.4. 


3 REQUIREMENTS ON SYSTEMATIC ERRORS 

In this section, we derive the requirements for systematic uncertain¬ 
ties on the shear estimates for the DES SV data. These requirements 
will be used to assess the quality of the PSF and shear catalogues 
in subsequent sections. 

Throughout this paper we will use the notation e = ei -|-ie 2 = 
|e| exp{2i(f>) as the complex-valued shape of each galaxy. We de¬ 
fine the shape e such that the expectation value of the mean shape 
for an ensemble of galaxies is an estimate of the mean reduced 
gravitational shear acting on those galaxies 

{e}=g=^, (3.1) 

I — K 


where 7 and k are the shear and convergence, respectively (see 
e.g. Hoekstra 2013 for a review of weak lensing concepts and ter¬ 
minology). 

For a galaxy with elliptical isophotes, one finds that |e| = 
(a — b)/{a + b) satisfies equation 3.1, where a and b are the semi¬ 
major and semi-minor axes of the ellipse. However, galaxies do 
not in general have elliptical isophotes, so this definition is of little 
practical value. For the more general case, the estimator 


Ixx lyy -f 2,^IxxEy Ey 


(3.2) 


has been proposed by Seitz & Schneider (1997), where the second 
moments of the intensity profile I{x, y) are defined as 

T _ ! dxdyI{x,y){iJ,-Jj){v-v) 

Jdxdylix,y) ■ 

But since neither shear algorithm in this paper uses equation 3.2 
directly, we consider equation 3.1 to be the functional definition of 
what we mean by the shape of an arbitrary galaxy. See §7.3.1 and 
§7.4.1 for details about the IM3SHAPE and NGMIX estimators of e. 

While equation 3.1 is our goal for the shape estimates in our 
catalogue, it is inevitable that there will be systematic errors in the 
shape measurements. A convenient parameterization, based on one 


3.1 Shear Correlation Eunctions 

We set our requirements on the various kinds of systematic errors 
according to how they propagate into the shear two-point correla¬ 
tion functions (defined as in Jarvis et al. 2003): 

C+(^') = (e* (x)e(x -b 0)) (3.5) 

( 6 ) = (e(x)e(x -b 0) exp(-4i arg(0))), (3.6) 

where * indicates complex conjugation. 

Substituting equation 3.4 into these equations and assuming 
the three types of systematic errors are uncorrelated (which is not 
necessarily trae in general, but is a reasonable assumption for set¬ 
ting requirements), we find 

SUO) - 2m^de) + r (0) (3.7) 

to leading order in each type of systematic, where i G {-b, — }, S^i 
are the systematic errors in the two correlation functions, are 
the auto-correlation functions of the PSF shapes, and are the 
auto-correlation functions of the additive error, c. 

To set requirements on 5^i, we consider how the errors will 
affect our estimate of the cosmological parameter ag, the present 
day amplitude of the (linear) matter power spectrum on the scale of 
8h~^ Mpc. Our requirement is that the systematic errors change the 
estimated value of ag by less than 3%, dog/ag < 0.03. This value 
was chosen to be about half of the expected statistical uncertainty 
on ag for the DES SV survey. 

Propagating this limit to the shear correlation functions, we 
obtain the requirement 

= P^Sag. (3.8) 

acrs 

This constraint assumes that errors are fully correlated across 0; 
assuming independent errors would be less restrictive. 


° In the complex formulation we are using, this would involve terms 
oepsF + a'eJsp. In formulations that treat [ 61 , 62 ] as a vector, a. would 
be a 2 X 2 matrix. 
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Figure 3. Requirement for the maximum systematic error contribution to 
the shear correlation functions. The blue lines correspond to ^crg/crs = 
0.03 for each of the correlation functions g-|- (solid) and (dashed). The 
top and bottom panels shows the requirement for the absolute and relative 
error in the correlation functions. 

Figure 3 shows the resulting requirements for derived for 
a flat ACDM central cosmological model with ag — 0.82, = 

0.047 and flc = 0.2344, h — 0.7 and Us = 0.96. 

We will apply this requirement to a number of different poten¬ 
tial sources of systematic error. If each of them just barely pass the 
requirement, this would be a problem, since the total net system¬ 
atic error would then exceed the requirement. We attempt to quan¬ 
tify the total realized systematic error in the shear measurements 
in §8.7; it is this total error that must be propagated into the next 
stage(s) of the analysis, along with any other non-measurement 
sources of systematic error (e.g. photometric redshift errors and in¬ 
trinsic alignments) that may be relevant for each specific science 
application. 


Figure 4. Requirement for the PSF leakage factor a based on the relative 
error in trg being less than 3%. 

of this will be systematic effects due to the PSF: both leakage and 
modeling errors, which will be discussed in the next two sections. 

Note that we do not need to satisfy these requirements for all 
values of 9. The statistical uncertainties on become much 

larger at large scales, so such scales are not as important for con¬ 
straining cosmology as smaller scales. In practice, equation 3.12 
should ideally be satisfied for scales 9 < 100 arcminutes, where 

(6^) are relatively well-measured. 

We note that these results are broadly consistent with those of 
Amara & Refregier (2008), who derived requirements for a tomo¬ 
graphic weak lensing survey, performing joint constraints on the 
set of cosmological parameters for a tuCDM model. They found 
requirements of \m\ < 4.0 x 10“^ and Crms < 2.1 x 10“® for 
DES SV survey parameters, which are in rough agreement with the 
requirements quoted above. 


3.2 Multiplicative and Additive Errors 

From equation 3.7, we find that the requirement on the multiplica¬ 
tive bias, m, is 

I I 1 

H< 2 

As can be seen from the lower panel in Figure 3, the most stringent 
requirement on is about 0.06, yielding a requirement on the 

multiplicative error of 

\m\ < 0.03. (3.10) 

The requirement on the additive systematic error is somewhat 
more complicated, since it is the correlation function of the ad¬ 
ditive systematic that matters. For a systematic error that is co¬ 
herent over small spatial scales (less than ~ 1 arcminute), the 
requirement comes from the zero-lag value of in Figure 3, 
(c") < <5e+""(0), or 

<2x10"^ (3.11) 

For additive errors that have longer correlation lengths, we 
will need to be more careful about calculating the correlation func¬ 
tion of the systematic error. The requirement in this case is 

ier(e)i < (3.12) 

using the function shown in Figure 3. The most notable example 


S^f 




(3.9) 


3.3 PSF Leakage 

The requirements for the PSF leakage term in equation 3.4 can 
be obtained from the general requirement on additive errors, equa¬ 
tion 3.12. 




(3.13) 


which can be solved for a as 


|a| < 


1 irf) J 


(3.14) 


Figure 4 shows this requirement on a as a function of 9 using 
the observed for DES SV data^. The requirement arising from 
is always larger than 0.05 and is not shown. 

In general, the amount of leakage of PSE shapes into galaxy 
shapes from an imperfect correction scheme is not expected to vary 
with scale. Rather, we can use Eigure 4 to determine a conservative 
requirement for a that would be applicable for scales 9 < 100 
arcminutes: 


|a| < 0.03. (3.15) 

We will estimate a from the data in §8.2. 


^ See Figure 20, top panels. We use the IM3SHAPE measurement of 
here. 
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3.4 PSF Model Errors 


requirement on the mean error in the PSF size 


We now consider errors in the modeling of the PSF itself. The pre¬ 
vious section dealt with the possibility of the galaxy shear estima¬ 
tion algorithm imperfectly accounting for the PSF convolution and 
letting some of the PSF shape leak into the galaxy shape. Flowever, 
even a perfect PSF correction scheme can suffer systematic biases 
if the PSF model itself is biased. 

As our starting point, we use the unweighted moments approx¬ 
imation of Paulin-Flenriksson et al. (2008), who give the bias on 
the measured galaxy ellipticity in terms of errors in the PSF model 
(their equation 13)®: 


^Csys 


(e — Cpsf) 


f Tpsp ^ 

1 ^TpSF 

/ TpSF \ 

V Tgal J 

TpSF 

Ugal) 


^Cpsp, 


(3.16) 


where T = + lyy is the intensity-weighted second moment of 

the radius (written as E? in their paper). Tgai refers to the intrinsic 
galaxy size, unconvolved by the PSF. 

Constructing the shear correlation function with this model, 
we find that the systematic error in is 



where pi {6) and p 2 {d) are defined as (cf. Rowe 2010) 

pi(6») = (5epsF(x)(5epsF(x-f 0)) 
p2{0) = (epsF(x)5epsF(x -f 9)), 

and we introduce three new statistics defined as® 

P 3 ( 6 ») = ^epsF^^^(x-f 0 )^ 

P4(0) = {^5epsp(x) ^epsF^^^(x-F0)^ 

P5(0) = (|epsF(x) (^epsF^^^ (x -f 0)^ . 


(3.17) 

(3.18) 

(3.19) 

(3.20) 

(3.21) 

(3.22) 


There are corresponding terms for 5^-, which are negligible 
in practice and thus uninteresting as requirements. 

The first term in equation 3.17 is a multiplicative systematic, 
so the relevant requirement comes from equation 3.10. We approx¬ 
imate the ensemble average as a product of two averages to set a 


® The Paulin-Henriksson et al. (2008) formalism is based on e = (a? — 
b2)/(a2 + 6^) rather than our e shape measure, so there are factors of 0(1) 
differences that we are neglecting. Similarly, they derive their formula for 
unweighted moments, which are also not directly applicable to real shear 
estimation algorithms, differing again by factors of 0(1). Despite these 
possible shortcomings, we feel this is nonetheless a useful model for de¬ 
scribing PSF modeling errors. 

^ We note that Melchior et al. (2015) proposed a slightly different p 3 statis¬ 
tic. 



pulling the epsF factors out of the ensemble average. We believe it is more 
appropriate to leave them in, since errors in the size estimates could easily 
be coupled to the PSF shapes. 



< 0.03 



(3.23) 


This represents an error due to improperly accounting for the “di¬ 
lution”, the amount by which the blurring of the PSF makes objects 
rounder than they originally were. Estimating the wrong PSF size 
will lead to a systematic multiplicative bias in the inferred galaxy 
shapes. 

The other terms are additive errors, contributing to ^+^(0), so 
the requirements from equation 3.12 are that each term be less than 


|P 1 , 3 , 4 W| < 


(3.24) 

(3.25) 


We will test these requirements for our PSF model below in §4.4. 

For our data, we compute the factor (Tpsp/rgai) that appears 
in these requirements to be 1.20 for IM3SHAPE and 2.42 for NG- 
MIX; the latter is larger because the final galaxy selection for the 
NGMIX catalogue keeps more small galaxies than the IM3SHAPE 
selection. We use the NGMIX value in §4.4, as it gives the more 
stringent requirement. For a, we conservatively use the value 0.03. 
We will find in §8.2.2 that hoth codes estimate a to he consistent 
with zero; however, it is not estimated much more precisely than 
this value. 


4 PSF ESTIMATION 

The principal confounding factor that must he addressed in order 
to measure accurate shears is the convolution of the galaxy sur¬ 
face brightness profiles by the point-spread function (PSF). The net 
PSF is due to quite a number of physical processes including at¬ 
mospheric turbulence, telescope and camera aberrations, guiding 
errors, vibrations of the telescope structure, and charge diffusion in 
the CCDs, among other more subtle effects. Furthermore, this PSF 
is not constant, but varies both spatially over the focal plane and 
temporally from one exposure to the next. The atmospheric com¬ 
ponent varies approximately according to a Kolmogorov turbulent 
spectrum. The optical aberrations have characteristic patterns due 
to features in the telescope optics. 

Fortunately, we do not need to have a complete physical model 
of all the contributors to the PSF in order to accurately character¬ 
ize it. Instead, we build an empirical model, based on observations 
of stars, which we interpolate to obtain an estimate of the PSF at 
any location on the focal plane. In this section, we describe how 
we select appropriate stars to use, and then build and test the PSF 
model. 


4.1 Initial Identification of Stars 

We first selected the stars to be used to constrain the PSF model. As 
stars are point sources, observations of them provide a sample im¬ 
age of the PSF at the location of each star. We desired a high-purity 
sample of fairly bright stars to make sure we did not erroneously 
consider images of small, faint galaxies to be images of the PSF, as 
that would bias the resulting PSF model. 
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Magnitude 


Figure 5. An example size-magnitude diagram for a single CCD image, 
used to identify stars. The size T = 2a-^ is based on the scale size of the 
best-fitting elliptical Gaussian. The pink and green points are the objects 
initially identified as stars. The green points ai'e the ones that pass our se¬ 
lection criteria outlined in §4.2, most notably the magnitude cut to avoid 
objects contaminated by the brighter-fatter effect. These objects are then 
used to constrain the PSF model. The blue circles show an an alternate 
star classification, called the Modest Classification within DES, which was 
found not to work as well for our specific purpose. 

We found that, for some CCD images, the sets of objects iden¬ 
tified as stars by the Modest Classification scheme^® included a 
relatively high number of galaxies, and in other cases too few stars 
were identified. The cause of these failures is dependent on many 
factors, but may be partly related to the use of coadd data for the 
classification. The coadd PSF can change abruptly at the locations 
of chip edges in the original single-epoch images, which may have 
affected the stellar classification near these discontinuities. 

Ultimately, the problems with the modest classifier were com¬ 
mon enough that we decided to develop a new algorithm tailored 
specifically to the identification of a pure set of PSF stars. Our algo¬ 
rithm works on each CCD image separately, using a size-magnitude 
diagram of all the objects detected on the image. For the magni¬ 
tude, we use the SEXTRACTOR measurement mag_auto. For the 
size, we use the scale size, a, of the best-fitting elliptical Gaus¬ 
sian profile using an adaptive moments algorithm. We found that 
these measures produce a flatter and tighter stellar locus than the 
FLUX_RADIUS value output by SEXTRACTOR, and is thus better 
suited for selection of stars. As a further improvement, we initialize 
the algorithm with some stars identified by SEXTRACTOR to have 
CLASS_STAR between 0.9 and 1.0. This was found to give a decent 
estimate of the size of the PSE, providing a good starting guess for 
the location of the stellar locus. 

The stars are easily identified at bright magnitudes as a locus 
of points with constant size nearly independent of magnitude. The 
galaxies have a range of sizes, all larger than the PSE size. Thus, 
the algorithm starts with a tight locus at small size for the stars 
and a broad locus of larger sizes for the galaxies for objects in the 
brightest 5 magnitudes (excluding saturated objects). Then the al¬ 
gorithm proceeds to fainter magnitudes, building up both loci, until 


Stars were identified as (bright_test OR locus_test) in terms 
of the pseudo-code presented in §2.2 


the stellar locus and the galaxy locus start to merge. The precise 
magnitude at which this happens is a function of the seeing as well 
as the density of stars and galaxies in the particular part of the sky 
being observed. As such the faint-end magnitude of the resulting 
stellar sample varies among the different exposures. 

Figure 5 shows such a size-magnitude diagram for a repre¬ 
sentative CCD image. The stellar locus is easily identified by eye, 
and the stellar sample identified by our algorithm is marked in pink 
and green. The pink points are stars that are removed by subse¬ 
quent steps in the process outlined below, while the green points are 
the stars that survive these cuts. The blue circles show the objects 
identified as stars according to the Modest Classification, which in¬ 
cludes more outliers and misses some of the objects clearly within 
the stellar locus. 

While the algorithm we currently use is found to work well 
enough for the SV data, we plan to investigate whether the neural 
net star-galaxy separator recently developed by Soumagnac et al. 
(2015) is more robust or could let us include additional stars. 

4.2 Selection of PSF Stars 

Some of the stars in this sample are not appropriate to use for 
PSF modeling, even ignoring the inevitable few galaxies that get 
misidentified as stars. The CCDs on the Dark Energy Camera each 
have six spots where 100 micron thick spacers were placed behind 
the CCDs when they were glued to their carriers (cf. Elaugher et al. 
2015), which affects the electric field lines near each 2mm x 2mm 
spacer. These features, which we call tape bumps, distort the shapes 
in those parts of the CCDs, so the stellar images there are not ac¬ 
curate samples of the PSE. We exclude any star whose position is 
within 2 PSF FWHM separation of the outline of a tape bump. The 
tape bumps are relatively small, so this procedure excludes less than 
0.1% of the total area of the CCD, but removes a noticeable bias in 
the PSF model near the bumps. 

Another problem we addressed with regards to star selection 
is the so-called “brighter-fatter effect” (Antilogus et al. 2014; Guy- 
onnet et al. 2015). As charge builds up in each pixel during the 
exposure, the resulting lateral electric fields and increased lateral 
diffusion push newly incoming charges slightly away from the ex¬ 
isting charge. This makes bright objects appear a bit larger than 
fainter objects. In addition, an asymmetry in the magnitude of the 
effect between rows and columns can make bright stars more ellip¬ 
tical. The galaxies we used for weak lensing are generally faint, so 
the brightest stars do not accurately sample the PSF that we need to 
measure. Furthermore, the brighter-fatter effect does not manifest 
as a convolution of the signal, so the bright stars do not even pro¬ 
vide an estimate of the correct PSF to be used for bright galaxies. 

The appropriate solution is to move the shifted charge back to 
where it would have fallen in the absence of this effect. This will be 
implemented in future DES data releases (Gruen et al. 2015). Eor 
the current round of catalogues, we instead partially avoided the 
problem by removing the brightest stars from our sample. Specif¬ 
ically, we removed all stars within 3 magnitudes of the saturation 
limit for the exposure. That is, in our final selection of PSE stars 
we required that the brightest pixel in the stellar image be less than 
6 % of the pixel full well. Since the brighter-fatter effect scales ap¬ 
proximately linearly with flux, this reduces the magnitude of the 
effect by a factor of 16. We were left with stars of lower S/N, so it 
is not the ideal solution, but it is an acceptable interim measure (as 
we demonstrate below) until the more sophisticated solution can be 
implemented. 

In Eigure 6 we show the mean difference between the mea- 
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Figure 6. The residual size (top) and shape (hottom) of stars relative to that 
of the PSF model as a function of magnitude. The hatched region on the 
left shows the magnitude range of the stars we exclude from the sample to 
reduce the impact of the brighter-fatter effect. 
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Figure 7. The distribution of the number of stars per CCD image used for 
constraining the PSF model. 


120 
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sured sizes of observed stars and the size of the PSF model at 
their locations, using the model described below in §4.3. For the 
measurements of the sizes and shapes described here, we used the 
implementation of the HSM (Hirata & Seljak 2003; Mandelbaum 
et al. 2005) algorithm included in the GalSim software package. 
The hatched region marks the range we excluded to avoid the spuri¬ 
ous increase in PSF size from the brighter-fatter effect. In Figure 6 
we have also shown the mean difference in ellipticity due to the 
brighter-fatter effect; it affects the shapes of the stars as well as the 
size. 

We do not yet understand why the residual sizes and shapes 
shown in Figure 6 do not level off to zero at fainter magni¬ 
tudes where the brighter-fatter effect is negligible. The require¬ 
ment on this residual value is given by equation 3.23. We calculate 
(57psf/7psf) to be 0.0044, which is well below our requirement of 
0.013 for the SV data. However, this residual will not be accept¬ 
able for future DBS analyses, so we will need to investigate what is 
causing the problem and fix it. 

In the complete process described above we find a median of 
130 useful stars per CCD image, which we use to constrain the PSF 
model. The distribution is shown in Figure 7. 

In Figure 8 we show the distribution of the median measured 
full-width half-max (FWHM) for the PSF stars used in our study, 
restricted to the exposures used for shear measurements. The over- 


Figure 8. The distribution of the median FWHM of the PSF stars in the non- 
blacklisted exposures (cf. §5.1). The r, i and z-band exposures are indicated 
from top to bottom within each bar in red, purple, and black. 

all median seeing of these exposures was 1.08 arcsec. The r, i and 
«-bands had median seeing of 1.11, 1.08, and 1.03 arcsec respec¬ 
tively. This was somewhat worse than expected (0.9 arcesec) and 
reflects the fact that a number of problems related to the instru¬ 
ment, telescope, and control software were being diagnosed and 
fixed concurrently with the observations. The realized seeing has 
significantly improved in the subsequent main survey observations 
(Diehl et al. 2014). 

For some CCD images no stars passed our final selection cri¬ 
teria, usually because the initial stellar selection could not find any 
stars or no stars survived the magnitude cuts. For instance, this can 
happen when there is a very bright object in the image that essen¬ 
tially masks out the entire image, leaving zero or very few objects 
detected. In less extreme cases, a bright object can sufficiently con¬ 
taminate the fluxes and sizes of the other detections that the stellar 
locus is either difficult to find or merges with the galaxy locus at 
a fairly bright magnitude, such that the brighter-fatter cut excludes 
the entire sample. 
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Whenever the process failed for any reason on a given CCD 
image, we flagged the image and excluded it from being used in 
subsequent shear estimation. We also flagged images with less than 
20 identified PSF stars, since it is difficult to accurately interpolate 
the PSF model with so few stars. These flagged images were added 
to the set of blacklisted images described in §5.1. 


4.3 PSF Measurement and Interpolation 

To measure the PSF and its spatial variation on each CCD, we 
used the software package PSFEx (Bertin 2011). Normally, PSF- 
Ex takes as input the full list of objects detected by SEXTRACTOR 
and finds the bright stars automatically. However, as described in 
§4.2, we removed some of the stars in the catalogue to avoid the 
brighter-fatter effect and the tape bumps. This edited catalogue of 
stars was then passed to PSEEx. 

We used the basis_type = pixel_auto option, which uses 
pixelated images to model the PSE profile, rather than fitting to 
some functional form. In Kitching et al. (2013), for undersampled 
PSFs a fixed oversampling was found to perform better than the 
default PSFEx choice; therefore, we forced the oversampling of 
these images to be a factor of 2 finer than the original pixel size with 
PSF_SAMPLING = 0.5. The basis images are set to be 101 x 101 
in the resampled pixels, or approximately 13 arcseconds on a side. 

For the interpolation, we used a second order polynomials in 
chip coordinates, interpolated separately on each CCD. Specifi¬ 
cally, we use the following parameters: 

PSFVAR_KEYS = XWIN_IMAGE,YWIN_IMAGE 
PSFVAR_GROUPS = 1,1 
PSFVAR_DEGREES = 2 

We found that there was not much gain in using higher order poly¬ 
nomials than this and some evidence that they were overfitting the 
noise for some CCDs. So we decided to use second order in all 
cases. 

To assess the quality of the PSF interpolation, we first exam¬ 
ined the differences between the measured shapes (using the HSM 
algorithm again) of actual stars on the image and the correspond¬ 
ing values for the PSFEx model at the locations of these stars. In 
Figure 9 we show the whisker plots of the PSF and the residuals as 
a function of position on the focal plane. The residual whiskers are 
small, but not quite zero. The impact of these spatially correlated 
residuals are investigated below in §4.4, and we will show that they 
meet the requirements for science with SV data. 

We believe the remaining structure seen in the residual plot 
is largely due to the fact that the PSF modeling and interpolation 
is done in pixel coordinates rather than sky coordinates. Therefore, 
the interpolation must also include the effects of the non-uniform 
WCS. In particular, the distortion due to the telescope optics is a 
fifth order radial function, but we fit the PSF with only a second 
order polynomial on each CCD. This is most markedly seen in the 
CCDs near the edges of the field of view where the residuals look 
consistent with a fifth order radial function after the local second 
order approximation has been subtracted off. One of our planned 
improvements to the analysis is to interpolate the PSF in sky co¬ 
ordinates rather than pixel coordinates, so that WCS variations can 
be modeled separately from real PSF variations. We expect this 
change to remove most of the remaining residual PSF pattern. 


4.4 PSF Model Diagnostics 

Errors in the PSF model, and particularly errors in the interpolation, 
will directly affect the shear estimates of galaxies, since they would 
be accounting for the effect of the PSF convolution incorrectly, as 
discussed in §3.4. If the PSF errors were random, independent val¬ 
ues for each galaxy, they would constitute merely an additional 
contribution to the shear measurement uncertainty, which would be 
highly subdominant to other sources of statistical noise, such as the 
unknown intrinsic shapes of the galaxies. However, this is not the 
case. Because the PSF is interpolated between stars, the errors in 
the PSF estimate are correlated among nearby galaxies. The two- 
point correlation function of these errors will directly impact the 
two-point correlation function of the shear estimates, which means 
they would be a systematic error, as quantified in equation 3.17. 

Rowe (2010) describes two diagnostic functions to quantify 
the level of interpolation errors in the PSF model using the mea¬ 
sured shapes of stars and the interpolated value of the model at the 
locations of these stars. As we already introduced in §3.4, 

pi (61) = {5epsF(x)(5epsF(x + 0)) (4.1) 

P2(6») = (epsF(x)fepsF(x -f 9 )), (4.2) 

where (5epsF represents the difference between the measured ellip- 
ticity of the observed stars and the ellipticity of the PSFEx models 
at the same locations, which is an estimate of the systematic uncer¬ 
tainty in the shape of the PSF model at those locations. 

In addition, we test three other statistics that appear at the 
same order of the expansion of PSF model errors, involving er¬ 
rors in the PSF size, Tpsf, which we call pa, p 4 , and ps. They are 
defined in equations 3.20 - 3.22 and are generally smaller than the 
two described by Rowe (2010). 

Figure 10 shows the results for these five statistics. The shaded 
regions show the requirements, from equations 3.24 & 3.25. In all 
cases, the results are seen to be passing our requirements for scales 
less than about 100 arcminutes. We see in Figure 10 that pi changes 
sign twice and is below the requirement line by only a factor of ~ 
2. However, our requirements make the conservative assumption 
that additive errors are fully correlated across scales. So we have 
directly propagated the measured pi through to the bias on ag and 
found the influence on as to be much less than one percent. 

Of course, the PSFEx model describes the full surface bright¬ 
ness profile of the PSE, not just its shape Cpsf and size Tpsf. How¬ 
ever, these are the dominant ways that errors in the PSF model 
could affect the galaxy shapes, so these statistics are the most im¬ 
portant checks of the model accuracy. 


5 Multi-Epoch Data Structures 

As outlined in §2, we used the coadd images for object detection 
and deblending. For shear measurement we worked directly with 
the pixel data from the original single-epoch images (cf. §7.1). To 
simplify the bookkeeping we developed a new data storage format, 
which we named Multi-Epoch Data Structures (MEDS)^^. 

We created a MEDS file corresponding to each coadd image. 
In these files we stored a postage stamp for each observation of ev¬ 
ery object detected in the coadd image along with the correspond¬ 
ing weight maps, segmentation maps, and other relevant data. The 
postage stamps for each coadd object were stored contiguously in 
the file, making sequential access of individual objects efficient. 

https ; //github . com/esheldon/meds 
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Figure 9. Whisker plots of the mean PSF pattern (left) and of the mean residual after subtracting off the model PSF (right) as a function of position in the 
focal plane. The length of each whisker is proportional to the measured ellipticity, and the orientation is aligned with the direction of the ellipticity. There is 
still some apparent structure in the plot of the residuals, but the level is below the requirements for SV science. Reference whiskers of 1% and 3% are shown 
at the bottom of each plot, and we have exaggerated the scale on the right plot by a factor of 10 to make the residual structure more apparent. 




Figure 10. The p statistics for the PSF shape residuals. Negative values are shown in absolute value as dotted lines. The shaded regions are the requirements 
for SV data. 
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The files are quite large, so loading the whole file into memory is 
not generally feasible, but it is also not necessary. 

The postage stamps from the original single-epoch images 
were sky-subtracted and then scaled to be on a common photomet¬ 
ric system, which simplified the model fitting using these images. 
We also stored the local affine approximation of the WCS function, 
evaluated at the object centre, so that models could be made in sky 
coordinates and constrained using the different image coordinates 
for each postage stamp. 

See Appendix A for details about how we build and store the 
MEDS files. 

5.1 Exposure Selection 

We did not use all single-epoch images for measuring shapes. We 
excluded a small fraction of the CCD images that had known prob¬ 
lems in the original data or in some step of the data reduction and 
processing. We created simple “blacklist” files, in which we stored 
information for CCD images we wished to exclude, and that infor¬ 
mation was incorporated into the MEDS files as a set of bitmask 
flags. Postage stamps from blacklisted images were then easily ex¬ 
cluded from the analysis when measuring shears. Here we list some 
of the reasons that images were blacklisted. 

Some of the astrometry solutions (cf. §2.3) provided a poor 
map from CCD coordinates to sky coordinates. This happened pri¬ 
marily near the edges of the SPT-E region where there are not 
enough overlapping exposures to constrain the fit. 

Some of the PSF solutions (cf. §4) provided a poor model of 
the PSF across the CCD. In some cases there were too few stars 
detected to constrain the model; occasionally there was some error 
when running either the star finding code or PSFEx. 

A small fraction of the SV images were contaminated by 
bright scattered-light artefacts. Scattered-light artefacts fall into 
two broad categories: internal reflections between the CCDs and 
other elements of the optics, known as “ghosts”; and grazing in¬ 
cidence reflections off of the walls and edges of the shutter and 
filter changer mechanism. Ghosts primarily occur when a bright 
star is within the field of view, while grazing incidence scatters oc¬ 
cur predominantly for stars just outside the field-of-view. Using the 
positions of bright stars from the Yale Bright Star Catalogue (Hof- 
fleit & Jaschek 1991) and knowledge of the telescope optics, it is 
possible to predict locations on the focal plane that will be most af¬ 
fected by scattered light. We identified and removed a total of 862 
CCD images (out of 135,481) from the single-exposure SV data set 
in this manner. In April 2013, filter baffles were installed to block 
some of this scattered light, and non-reflective paint was applied to 
the filter changer and shutter in March 2014 (Flaugher et al. 2015). 
These modifications have greatly reduced the occurrence of grazing 
incidence reflections in subsequent DES seasons. 

It is common for human-made objects to cross the large DE- 
Cam field of view during an exposure. The brightest and most im¬ 
pactful of these are low-flying airplanes (two Chilean flight paths 
pass through the sky viewable by the Blanco telescope). Airplane 
trails are both bright and broad, and cause significant issues in esti¬ 
mating the sky background in CCDs that they cross. We identified 
these airplane trails by eye and removed a total of 56 individual 
CCD images due to airplane contamination (corresponding to 4 dis¬ 
tinct exposures). This rate of airplane contamination is expected to 
continue throughout the DES survey. 

In addition to airplanes, earth-orbiting satellites are a common 
occurrence in DES images. During the 90 second exposure time of 
a DES survey image, a satellite in low-earth-orbit can traverse the 
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Figure 11. Example galaxy image demonstrating two masking strategies. 
The top row shows the original postage stamps in the MEDS file. The 
second row shows the result when only the SEXTRACTOR segmentation 
map was used to mask neighbors. The third row shows the result when the 
tiberseg algorithm was used to mask neighbors, as described in the text. 

entire focal plane, while geosynchronous satellites travel approxi¬ 
mately 1.25 CCD lengths. The impact of these satellite streaks is 
significantly less than that of airplanes; however, because they only 
occur in a single filter, they can introduce a strong bias in the colour 
of objects that they cross. For SV, the “crazy colours” cut men¬ 
tioned in §2.1 removes most of the contaminated objects. At the 
end of Year 1, an automated tool was developed by DESDM for 
detecting and masking satellite streaks using the Hough transform 
(Hough 1959; Duda & Hart 1972). This should greatly reduce the 
impact of satellite streaks in upcoming seasons of DES observing 
and will be retroactively applied to reprocessing of earlier data. 

5.2 Masks 

The user can construct a “mask” for each postage stamp in the 
MEDS files in a variety of ways. For this analysis, we used what 
we call an “uberseg” mask, constructed from the weight maps, seg¬ 
mentation maps and locations of nearby objects. 

To create the uberseg mask, we started with the SEXTRACTOR 
segmentation map from the coadd image, mapping it on to the cor¬ 
responding pixels of the single-epoch images. We prefer this map to 
the segmentation map derived for each single-epoch image because 
the coadd image is less noisy, and thus has more object detections 
and more information for determining the extent of each object. 

We then set pixels in the weight map to zero if they were ei¬ 
ther associated with other objects in the segmentation map or were 
closer to any other object than to the object of interest. The result 
was a superset of the information found in the weight maps and 
segmentation maps alone, hence the name uberseg. 

An example set of images and uberseg maps are shown in Fig¬ 
ure 11 . In tests on a simulation with realistically blended galaxies 
(cf. §6.2), we found a large reduction in the shear biases when using 
the uberseg masking as compared to the ordinary SEXTRACTOR 
segmentation maps. In particular, when using ordinary segmenta¬ 
tion maps we found a significant bias of the galaxy shape in the 
direction toward neighbors. With the uberseg masking, such a bias 
was undetectable. 
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6 SIMULATIONS 

Simulations were a crucial part of our shear pipeline development 
process, providing data with known values of the applied shear for 
testing the shear estimation code. There is no such absolute cali¬ 
bration source in the real data. In addition to many small targeted 
simulations designed to answer particular questions about the algo¬ 
rithms, we developed two general purpose simulations that we used 
extensively to test the shear pipelines. 

The first, which we call GREAT-DES, was modeled on the 
GREAT3 challenge. We used the GREAT-DES simulation to test 
the accuracy of the shear estimation codes on realistic space-based 
galaxy images with a realistic range of noise levels and galaxy 
sizes. As with the GREAT3 challenge, the galaxies were placed 
on postage stamps, so there were no blending or object detection 
issues to consider. 

The second, which we call the end-to-end simulation, was a 
high S/N simulation with analytic galaxy models with elliptical 
isophotes. The motivation with these simulations was to test that 
various bookkeeping details were implemented correctly, such as 
the file conventions used by PSFEx, the application of the WCS 
transformations, and conventions about the origin of the postage 
stamps in the MEDS files. These are all details that are easy to get 
wrong, but which can be difficult to notice on noisy data. In these 
simulations we also tested the efficacy of the uberseg masking (c.f. 
5.2). 

We have found the GalSim (Rowe et al. 2015) image simu¬ 
lation software to be invaluable for this purpose. In particular, its 
ability to accurately render sheared versions of space-based images 
using their reimplementation of the SHERA algorithm (SHEar Re¬ 
convolution Analysis; Mandelbaum et al. 2012), correctly account¬ 
ing for the original HST PSF (Bernstein & Gruen 2014), was par¬ 
ticularly important for making the GREAT-DES simulation. The 
end-to-end simulation relied on GalSim’s ability to generate mul¬ 
tiple epochs of the same scene and accurately handle non-trivial 
WCS transformations for the various exposures. 


6.1 GREAT-DES 

We used the GREAT-DES simulation to test the precision and accu¬ 
racy of our shear measurement codes, using DES-tuned sampling 
of both the population of galaxies (size, shape, morphology) and 
the observing conditions (PSF ellipticity, noise level). The simula¬ 
tion consists of individual 48 x 48 pixel postage stamp images. We 
ignored issues of crowding, bad pixels, and imaging artefacts, but 
we otherwise attempted to make the images a close approximation 
to the DES SV data. 

We built the GREAT-DES simulation using galaxies from the 
COSMOS survey (Koekemoer et al. 2007), made available for use 
with GalSim^^. Kannawadi et al. (2015) showed that this sample 
of galaxies is a good representation of galaxy properties, and can 
be used in shear calibration of lensing surveys to a precision level 
of m = 0 . 01 . 

We started with the entire COSMOS sample distributed for 
use with GalSim and discarded objects that were flagged as un¬ 
usable in the GREAT3 challenge (Mandelbaum et al. 2014), which 
removed about 3% of the objects and left more than 54,000 COS¬ 
MOS galaxies available for use in the simulation. Next we selected 


https : //github . com/GalSim-developers/GalSim/ 
wiki/RealGalaxy%2 OData 


individual galaxies from this set in such a way as to mimic the dis¬ 
tribution of galaxy properties found in DES SV data. 

For the PSF, we used a Kolmogorov profile with sizes and el- 
lipticities taken to match the range of values present in the S V data. 
Specifically the PSF size took one of 6 values between 0.8 and 1.3 
arcseconds FWHM, and each component ei, 62 of the shape took 
one of 4 values from -0.02 to -t0.02. Thus, a total of 96 unique PSF 
images were used in the entire sample. Gaussian noise was added 
based on the typical noise level observed in SV coadd images. 

We then applied a constant shear value within each simulation 
field, with a magnitude of | (/| = 0.05 and rotated at 8 evenly spaced 
position angles </>. 

Each of the COSMOS galaxies was used hundreds of times, 
with different noise realizations, different random orientations and 
different centroid offsets. We did not use 90 degrees rotated galaxy 
pairs, as has commonly been done for the GREAT challenges (cf. 
Kitching et al. 2010) to reduce the number of galaxies required 
to reach a given measurement precision. We instead randomly ori¬ 
ented each galaxy. With this choice, we retained the ability to se¬ 
lect subsets of the galaxies according to their measured characteris¬ 
tics. Such selections tends to break up the pairs, which obviates any 
advantage from using them. More importantly, additive errors can 
cancel between the pairs of galaxies, which would hide important 
systematic errors that would yet appear real data. Therefore, we in¬ 
stead use a very large number of galaxies in each field to get to 
the desired precision on the mean shear. In total, we use 48 million 
rendered galaxy images. 

We developed a DES-specific module for GalSim to store 
the simulated images directly in MEDS format, so we could run 
IM3shape and NGMIX on the resulting MEDS files with minimal 
modification compared to how we run the code on the data. We did 
not actually create multiple epochs for this simulation, but it was 
helpful to use the same file format as the data. 

To estimate the level of systematic errors well, we desired the 
simulation to be closely representative of the data (see e.g. Berge 
et al. 2013; Bruderer et al. 2015). To check that we have achieved 
this goal, we compared the IM3SHAPE measurements of relevant 
galaxy properties in GREAT-DES to those in the SV data. In Fig¬ 
ure 12 we show that the distributions of ellipticity, size and S/N 
are well-matched between the simulation and the data, as is the de¬ 
pendence of Rg and Rgp/Rp as functions of S/N. The bulge frac¬ 
tion, estimated by which model IM3SHAPE chooses as the better 
fit, shows systematic disagreement as a functioin of S/N, although 
the overall bulge fraction matches very well: 0.161 and 0.167 for 
the simulation and the data respectively. 

Note that the choice to show IM3SHAPE measurements in 
Figure 12 is arbitrary; the analogous plot of NGMIX measure¬ 
ments shows similar agreement, except that there is no estimate of 
bulge fraction from the NGMIX exponential disc model. Also, the 
IM3shape “bulge fraction” should not be considered an estimate 
of the actual Sersic index of the galaxies; it is merely a diagnostic 
measure related to the concentration of the galaxies. 

Since NGMIX uses an exponential disc model (cf. §7.4.1), and 
thus has worse model bias for bulge-like galaxies, the discrepancy 
in the bulge fraction limits our ability to infer what the model bias 
would be in real data (cf. §8.5). The IM3shape shear estimate is 
based on a bulge-or-disc galaxy model (cf. §7.3.1), which has less 
overall model bias (Kacprzak et al. 2014), so the discrepancy may 
have less impact. However, the ability to accurately choose bulge 
vs. disk is dependent on S/N, so our ability to test this aspect of 
the fitting is also somewhat limited in GREAT-DES. 
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Figure 12. A comparison of the galaxy properties in GREAT-DES (red) and the SV data (blue). The top row shows histograms of |e|, Rgp/Rp, and S/N as 
measured by IM3 shape. The bottom row shows the dependence of {Rg), {Rgp/Rp ), and bulge fraction as functions of S/N. 


6.2 End-to-end Simulation 

The end-to-end simulation is of an entirely different nature from the 
GREAT-DES simulation. It is a high S/N simulation used to test 
various mundane coding details that are easy to mix up, but which 
can be difficult to verify in noisy data. Eor the galaxies we used sim¬ 
ple exponential disc profiles, which have elliptical isophotes when 
sheared, and the images were rendered with relatively little pixel 
noise. The fundamental shape estimation problem is thus straight¬ 
forward for both algorithms. 

The starting point for this simulation was one of the actual 
MEDS files from the data, along with the corresponding coadd cat¬ 
alogue, the list of single-epoch images that contributed to the coadd 
image, and the WCS solutions and estimated background maps for 
each single-epoch image. 

Next we built new versions of these single-epoch images us¬ 
ing exponential disc galaxies with the same size, flux, ellipticity, 
and celestial position as the measurements of the real galaxies. We 
used variable elliptical Gaussian profiles for the PSE, using differ¬ 
ent parameters for each single-epoch image. The convolved images 
were rendered at the correct position on each image using the orig¬ 
inal WCS. With GalSim we applied the Jacobian of the WCS to 
the surface brightness profile as well, so this important detail was 
handled correctly. Objects that were deemed to be stars in the orig¬ 
inal catalogue (based on the SEXTRACTOR spread_model being 
less than 0.003) were drawn as a PSE profile, with the same flux as 


the original object. Einally, we added the original background sky 
level to the image, but with relatively small noise so that the faintest 
galaxies had S/N > 200. 

We then ran these images through the full weak lensing 
pipelines, starting with SEXTRACTOR and PSEEx to estimate 
the PSE model, then building a MEDS file, and finally running 
IM3 shape and NGMIX. The resulting measured shape estimates 
were then compared to the true shapes of the simulated galaxies, 
which were expected to match to quite high precision, given the 
nature of the simulation. 

The end-to-end simulation was successful in finding several 
bugs in various parts of the shear pipeline. However, the most no¬ 
table result from this process was the development of the uberseg 
mask (cf. §5.2). These tests revealed significant biases from the 
masking procedure we had been using, involving just the SEX¬ 
TRACTOR segmentation maps. When a galaxy had a bright neigh¬ 
bor on the same postage stamp, light from the neighbor that was 
just outside the segmentation map was being included as part of 
the fit, thus significantly biasing the inferred shapes in the direction 
of the neighbor. 

Switching to the uberseg mask made a big difference; we 
found the measured shapes were then much closer the true val¬ 
ues. We found there was still a small effect from neighbors, which 
amounted to a slight increase in the effective shape noise for such 
objects, but we no longer detected any systematic bias in the shape 
estimates due to unmasked flux from neighboring objects. 
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1 SHEAR MEASUREMENT 


7.2 Signal-to-noise Ratio 


We used two different shear measurement codes for this study: 
IM3shape and NGMIX, hoth of which are based on model-fitting. 
IM3shape performs a maximum likelihood fit using a bulge-or- 
disc galaxy model (cf §7.3.1). NGMIX uses an exponential disc 
model, exploring the full W-dimensional posterior likelihood sur¬ 
face with an informative prior applied on the ellipticity (cf. §7.4.1). 

With both shear methods we used the PSFEx models of the 
PSF detailed in §4.3, although the way the PSF model was used 
differed. PSFEx produces a 2-D image of the PSE profile at the 
location of each galaxy. With IM3 SHAPE we resampled the PSE 
image to a higher resolution grid and performed the convolution 
with the galaxy model via EFT. With NGMIX, we fit 3 free elliptical 
Gaussians to the PSF image and performed an analytic convolution 
with the galaxy model, which was also approximated as a sum of 
Gaussians, resulting in very fast model creation. 

Finally, with both shear codes we used the MEDS files de¬ 
scribed in §5 to constrain the galaxy models, using pixel data from 
the original single-epoch images rather than using the coadd image, 
which we only used for object detection. 

We discuss the details of the multi-epoch fitting process in 
the next section, §7.1. In §7.2, we define what we mean by signal- 
to-noise. The details of the IM3SHAPE and NGMIX algorithms are 
given in §7.3 and §7.4. Finally, our strategy for blinding the shear 
estimates is described in §7.5. 


7.1 Multi-epoch Fitting 

The typical method for dealing with multiple exposures of a partic¬ 
ular patch of sky is co-addition of images (also known as “stack¬ 
ing”; cf. Fu et al. 2008). However, co-addition can be problematic, 
since it necessarily loses information and imparts non-trivial, spa¬ 
tially correlated noise into the final image. Furthermore, as each 
CCD covers a finite region of sky, addition of a finite number of 
CCD images results in discontinuities in the PSF at image bound¬ 
aries (cf. Jee et al. 2013 for a discussion of this effect). A more 
optimal method for fitting a collection of images is to simultane¬ 
ously fit all independent pixel data, as also advocated by Heymans 
et al. (2012b). We call this process multi-epoch fitting. 

Multi-epoch fitting requires some additional complexity in the 
fitting process, as we must use the correct PSF and WCS informa¬ 
tion for each image, rather than a single function for each as would 
be sufficient to process a coadd image. 

In order to simplify the bookkeeping to process the multi¬ 
epoch and multi-band DES data, we used the Multi-Epoch Data 
Structures described in §5. Each observation of a particular galaxy 
experiences a different PSF, and the local image coordinates are 
related to celestial coordinates via a different WCS transformation. 
This information was stored in the MEDS file and used during mod¬ 
eling. 

For both codes (NGMIX and IM3SHAPE) the model for a given 
set of galaxy parameters was generated in celestial coordinates. For 
NGMIX, we modeled the PSF in celestial coordinates as well, and 
convolved it with the galaxy model analytically. We then compared 
this model to the observed data using the WCS transformation. For 
IM3shape we modeled the galaxy and PSF in image coordinates 
and convolved via fast Fourier transform (FFT). 


Before we describe the algorithms we used for measuring shapes, 
it is worth describing in detail what we mean by the signal-to-noise 
ratio (SIN). This will be relevant both in the next section (in partic¬ 
ular §7.3.2, where we discuss how IM3SHAPE calibrates the shear 
bias) and in later sections such as §8.3, where we test that the shear 
is independent of S/N, and §9.1, where we use S/N while select¬ 
ing galaxies for the final shear catalogues. 

There is no single definition for the S/N of an image or a 
surface brightness profile. Rather, a S/N is only well defined for 
a single measured value - some statistic calculated from the image 
or profile. Given some such statistic x, the S/N is typically defined 
as that value (either the measurement or the true value) divided by 
the square root of its variance 


S/N 


X 

-/Var(x) 


(7.1) 


One of the standard S/N measures is the so-called “optimal” 
S/N estimator. One can show that among all statistics that are lin¬ 
ear in the pixel values Ip, 


Wpip, 

p 


(7.2) 


the one with the highest expected S/N has weights Wp = (Ip)/ g/, 
where are the estimated variances in each pixel. 

In practice, one does not know the true expectation value of 
the surface brightness profile, (/p), so typically one uses the best¬ 
fitting model of the galaxy, which we call rrip, as part of the weight. 
The S/N oi this statistic is thus estimated as 


(S/N) 


'Y/p fnpip/ Gp 
7 ^ \ 1 / 2 ' 

(Ep ■nxl/G^ 


(7.3) 


This is the S/N measure used by GREAT3 (Mandelbaum et al. 
2014), for example. 

A drawback of this estimator is that it is not independent of 
an applied shear. Galaxies that look similar to the PSF will have 
a higher measured {S/N)^, than galaxies with a different size or 
shape. The PSF essentially acts as a matched filter for these galax¬ 
ies. This means that is not invariant under an applied grav¬ 

itational shear. 

If the PSF is approximately round, as is the case for our data, 
then more elliptical galaxies will have a lower estimated {S/N).ui 
than round galaxies (holding flux constant). Thus if galaxies are 
selected according to their measured {S/N)^,, the resulting galaxy 
catalogue will have a selection bias towards round shapes, which 
will bias the overall mean shear. 

One solution to this potential systematic error is to use a S/N 
estimator that is not biased with respect to an applied shear. There 
are a number of choices one could make for this. We choose to 
calculate the {S/N)^, that the galaxy would have had if it and the 
PSF were round. 

That is, we take the model of the galaxy profile and apply a 
shear such that its ellipticity becomes zero. We do the same for 
the PSF, convolve these two profiles together, and then integrate 
over the pixels. The resulting rUp values are the intensities we pre¬ 
dict would have been observed if both the galaxy and the PSF had 
been round. We then use these values for both the model rrip and 


The proof involves finding Wp values such that expectation of the S/N 
is stationary with respect to any infinitesimal changes Swp. 
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the intensity Ip in equation 7.3, as the actual data are no longer 
appropriate for this counterfactual surface brightness profile. The 
“roundified” S/N estimator is then 



We find both measures of the signal-to-noise useful in differ¬ 
ent contexts. For NGMIX, we use (S/N)r for the reasons described 
here; we find significantly smaller selection biases when we use 
{S/N)r to select galaxies for shear measurement, as compared to 
using (S/N)^. 

For IM3shape, we find that the noise bias calibration (cf. 
§7.3.2) is more accurate using (S'/A^)™ than {S/N)r, presumably 
because the noise bias is more directly related to the signal-to-noise 
of the actual galaxy than to that of a counterfactual round version 
of the galaxy. Thus, the “noise bias” calibration in fact also approx¬ 
imately calibrates the selection bias resulting from using (S'/A^)u,. 
This is therefore the appropriate S/N measure to use for selecting 
galaxies for the final IM3SHAPE catalogue. 


7.3 Shear Measurements with im3shape 

IM3shape is a maximum-likelihood model-fitting code, which we 
used to fit de Vaucouleurs bulge and exponential disc components 
to galaxy images. The code was described in Zuntz et al. (2013), 
where its performance on GREAT08 and its known biases were 
characterized. 

We have slightly modified the model described therein, im¬ 
proving both its stability and its performance on the tests detailed 
in this paper (cf. §8). Previously each galaxy was modeled as the 
sum of two components, a bulge and a disc. In this paper, we fit 
each galaxy twice: once as a pure bulge and once as a pure disc. For 
shear estimation, we used the model with the higher likelihood, un¬ 
less that model was flagged as a bad fit (cf. §7.3.3). If both models 
were flagged the galaxy was excluded from the catalogue. 

We found this “bulge or disc” scheme to be much more robust 
on simulations of realistic galaxies. This scheme produced good 
model fits in almost all cases, whereas with the previous “bulge 
plus disc” scheme we frequently found the best fit model was un¬ 
physical, with highly negative-flux components. 

The parameters of the best-fitting model were found using 
the numerical optimizer LevMar^'^ (Lourakis 2004), which is an 
implemention of the Levenberg-Marquardt algorithm (Levenberg 
1944; Marquardt 1963), iterating towards a model image which 
minimizes the with the data image. 

For the SV data, we ran IM3SHAPE on r-band images only. 
With the future data we plan to test fitting multiple bands simulta¬ 
neously with marginalized relative amplitudes. 

We made a number of additions to the original code presented 
in Zuntz et al. (2013); in this section we briefly review the code and 
its methodology, with particular focus on these changes. 

The complete code with all the changes described below is 
available for download^®. One particularly useful infrastructure im¬ 
provement was the implementation of a Python interface to the ex- 


http://users.ics.forth. gr/-lourakis/levmar/ 
https : //bitbucket . org/joezuntz/im3shape 


isting C functions. We used the Python interface to load data from 
MEDS files (via the meds module), select exposures, mask images, 
and compute most of the diagnostic information described in §7.3.3 
below. 

The biggest change we made to IM3SHAPE was the addition 
of a new model which fits multiple exposures of the same galaxy 
simultaneously. We now define our model parameters in a celes¬ 
tial coordinate system: a local tangent plane centred at the nominal 
Right Ascension and Declination of the galaxy. This model is then 
constrained by the pixel data from each epoch where the galaxy 
was observed, as discussed in §7.1. 


7.3.1 Bulge or disc model 

Each galaxy model was defined by six varied parameters: the am¬ 
plitudes of either the bulge or disc components (Ai,,Ad), a cen¬ 
troid relative to the nominal detection position (Su, Sv), an elliptic- 
ity (ei, 62 ), and a half-light radius (r). 

To compute the likelihood of a particular model for a given 
galaxy observed on a number of individual exposures, we used 
the local affine approximation to the WCS for each postage stamp 
(stored in the MEDS file) to transform these parameters into each 
image’s local pixel coordinate system. Schematically, 

{Su, Sv, el, 62 , V} 

[{Sx,Sy,e’l,e^,r^}i^,,^^^, 

[Sx, Sy, ef, e^, > ■■•] C-5) 

where ° indicates the parameters in celestial coordinates (u, v) and 
^ indicates the transformed parameters in pixel coordinates (x,y). 
The amplitudes do not require any transformation, since the MEDS 
files have already put the postage stamps on the same photometric 
system. 

Given the appropriate parameters for each postage stamp, we 
then built the galaxy models in pixel coordinates, each convolved 
by the correct PSF for that stamp, and computed a x^ of the model 
relative to the data, using the correct pixel noise. The total x^ from 
all the postage stamps then gave us the final likelihood to use for 
that set of model parameters. We then iterated to find the maximum 
likelihood parameters for each galaxy. The maximum likelihood 
was typically found in less than 50 iterations. At 150 iterations, we 
stopped the algorithm and declared failure. 

The Levenberg-Marquadt code that we used to find the max¬ 
imum likelihood, LevMar, does not directly handle problems 
where different weights are applied to each data point. The straight¬ 
forward fix for this is to scale both the observed intensity Ip and the 
model rrip by the standard deviation of the intensity Op before pass¬ 
ing them to LevMar: 

tLM t / 

Ip — Ip/<Xp 

nip =mplap. (7.6) 

This maintains the x^ per pixel that the LevMar algorithm uses 
as its objective function. The estimates of Op came from the weight 
map (as CTj/^) provided with the images. 


7.3.2 Shear calibration 

A significant problem with maximum likelihood shear estimators 
is that the peak of the likelihood distribution is not an unbiased es¬ 
timator of the shear in the presence of noise (Refregier et al. 2012; 
Kacprzak et al. 2012). The fitted model parameters are a non-linear 
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Figure 13. Shear bias for IM3 shape measurements on the GREAT-DES simulation: multiplicative bias (left) and PSE leakage (right), as functions of the 
measured {S/N),n and Rgp/Rp. The fits, which are used to calibrate the shear estimates on the data, are smooth functions in both of these variables. Solid 
lines show the fits vs (S/Af)„ at particular choices of RgpjRp. 


function of pixel intensities affected by Gaussian noise, resulting in 
noise bias in the estimated shear values. The IM3SHAPE algorithm, 
being a maximum likelihood estimator, is known to suffer from this 
effect. 

In addition, we found a small selection bias, which is intro¬ 
duced by using recommended IM3SHAPE flags (cf. §7.3.3) and the 
selection based on galaxy size and S/N (cf. §9.1). We also expect 
a small amount of model bias due to realistic galaxies not always 
being well fit by our bulge-or-disc model. This model bias is ex¬ 
pected to be small compared to the requirements (Kacprzak et al. 
2014). 

To account for all of these sources of error in our shape 
measurements, we calculated bias corrections of the form shown 
in equation 3.4. Specifically, we fit for m and a as functions of 
(S'/W)u, (defined in equation 7.3) and Rgp/Rp (the FWHM of the 
PSF-convolved galaxy divided by the FWHM of the PSF) on sim¬ 
ulated data from the GREAT-DES simulation (cf. §6.1). We ran 
IM3shape on the simulated data in the same way as we do on the 
DES data, including the same choices of input parameters. 

In principle, the two multiplicative terms, mi and m 2 should 
be treated as independent biases. In practice, however, when av¬ 
eraged over many galaxies we find virtually no difference be¬ 
tween the two. As such, we correct both ei and 62 by the average 
m = (mi -F 1 X 12 ) 12 . 

We fit both m and a as two-dimensional surfaces in the S/N 
and size parameters. Due to the complicated structure of this sur¬ 
face, we fit m with 15 terms of the form {S/N)X[Rgp/Rv)~^, 
where x and y are various powers ranging from 1.5 to 4. To control 
overfitting, we used a regularization term in the least-square fit and 
optimized it such that the fitted surface has a reduced = 1- A 
similar procedure was applied to a, where we used 18 parameters 
in the fit. In Figure 13 we show these fits as curves in {S/N)^ in 
bins of Rgp/Rp. However, the actual functions are smooth in both 
parameters. 

We checked if our calibration is robust to the details of this 
model by ( 1 ) varying the number of terms in the basis expansion 
and (2) splitting the training data into halves. For both tests the 
changes in the mean multiplicative and additive corrections applied 
to the SV data did not vary by more than 1%. 

In §7.2, we mentioned that (S'/W)™ is a biased measure of 


S/N with respect to shear, so if it is used to select a population of 
galaxies, it will induce a selection bias on the mean shear. Rgp/Rp 
similarly induces such a bias. Thus, when we bin the shears by 
these quantities to construct the calibration functions, there is a se¬ 
lection bias induced in every bin. The scale of selection bias reaches 
m ~ —0.05 for the most populous bins. This is not a problem for 
the correction scheme so long as the overall selection is also made 
using these same quantities. In that case, the shear calibration au¬ 
tomatically accounts for the selection bias in addition to the noise 
bias. 

We tried using {S/N)r in the calibration model rather than 
(5'/W)u, to help reduce the level of the selection bias in each bin, 
but we found that it does not perform as well as using the standard 
(5'/W)u,. Perhaps not surprisingly, the noise bias seems to be more 
related to the S/N of the actual galaxy than it is to the counterfac- 
tual round version of the galaxy used for {S/N)r. In future work, it 
would be interesting to seek an effective shear calibration scheme 
that disentangles noise and selection biases, but we have not found 
one yet. 

We used these fits to estimate the multiplicative and addi¬ 
tive corrections to use for every galaxy in the IM3SHAPE cata¬ 
logue. However, it should be stressed that this bias estimate is it¬ 
self a noisy quantity, being based on noisy estimates of the size 
and S/N. Therefore one should not directly apply the correction to 
each galaxy individually. Rather, the mean shear of an ensemble of 
galaxies should be corrected by the mean shear bias correction of 
that same ensemble (cf. §9.2). 

Note that a selection bias can appear whenever a subset of 
galaxies is selected from a larger sample. In the cosmological anal¬ 
ysis, we apply recommended IM3SHAPE flags, cut on Rgp/Rp and 
(5'/W)u,, and then typically split the galaxies into redshift bins. 
The redshift selection in particular is not used in the shear calibra¬ 
tion process, so it is possible for there to be uncorrected selection 
biases in the different redshift bins. In §8.5, we test that the shear 
calibration nevertheless performs well in this scenario by applying 
the same selection procedure to the GREAT-DES simulation. There 
we demonstrate that all biases are removed to the required tolerance 
level in all redshift bins. 
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7.3.3 Diagnostics 

After performing the shape measurement, we generated a large 
suite of diagnostic information based on the results of the fits to 
help identify objects that potentially should not be used for weak 
lensing. Many objects showed evidence of imaging artefacts or 
some other problem that violates the assumptions we have made 
in the model, so we wanted to be able to remove these objects from 
the final shear catalogue. 

We distinguished two types of flags: “error” flags, which iden¬ 
tify objects that should definitely be removed from any analysis, 
and “info” flags, which identify objects that may be somewhat con¬ 
taminated, but which may have some value depending on the sci¬ 
ence application. Most of the info flags are derived by examining 
histograms of the relevant parameters and flagging extreme tails. 

The full listing of IM3SHAPE flags is given in Appendix Bl. 
In §9.1, we will detail the final selection criteria that we recom¬ 
mend for the IM3 shape catalogue, which will include both er- 
ROR_FLAG==0 and INFO_FLAG==0. Moving to a less restrictive 
selection should only be done after carefully testing for the pos¬ 
sibility of increased systematic errors. 

7.3.4 Galaxy weights 

We assigned a weight to each shear measured by IM3SHAPE based 
on an estimate of the total shear uncertainty including both shape 
noise csn (the standard deviation of the intrinsic ellipticities) and 
measurement uncertainty (j^\ 


The LevMar Levenberg-Marquardt implementation we used 
produces an estimate of the parameter covariance for each galaxy 
as a by-product of optimization, but we did not use this estimate to 
give us weights, for two reasons. First, we found it to show rather 
wide scatter when compared to MCMC tests, often showing spuri¬ 
ous parameter covariances. Second, our physical parameters are a 
non-linear function of the numerical parameters in some regimes, 
as discussed in Zuntz et al. (2013). 

To estimate the appropriate weight for each galaxy, we instead 
used the measured shears from the GREAT-DES simulation. We 
grouped galaxies in bins of (S/A^)™ and Rgp/Rp. We then mea¬ 
sured the width of the distribution of ellipticities in each bin, both 
by fitting a Gaussian to a histogram of the distribution and by mea¬ 
suring the sample variance directly. The larger of the two variance 
estimates was taken, and the weight was then given by the inverse 
variance. 

We also imposed a maximum weight set by the mean variance 
of all high-S'/A^ bins. Otherwise spuriously low variance estimates 
in some sparsely populated bins resulted in very high weight values 
for those bins. 


7.4 Shear Measurements with ngmix 

The code NGMIX is a general tool for fitting models to astronom¬ 
ical images (Sheldon 2014). The code is free software^®, and is 
available for download ^'. 

In NGMIX both the PSF profile and the galaxy are modeled 

https : //www . gnu . org/philosophy/free-sw . html 
https : //github . com/eshe1don/ngmix 


using mixtures of Gaussians, from which the name NGMIX is de¬ 
rived. Convolutions are thus performed analytically, resulting in 
fast model generation as compared to methods that perform the 
convolution in Fourier space. 


7.4.1 Exponential disc model 

For the galaxy model, NGMIX supports various options including 
exponential discs, de Vaucouleurs profiles (de Vaucouleurs 1948), 
and Sersic profiles (Sersic 1963), all of which are implemented ap¬ 
proximately as a sum of Gaussians using the fits from Hogg & Lang 
(2013). Additionally, any number of Gaussians can be fit, either 
completely free or constrained to be co-centric and co-elliptical. 
For the DES SV catalogues, we used the exponential disc model 
for galaxies. 

Using this simple disc model resulted in detectable model bias 
(cf. §8.5). In simulations, we found this model bias was reduced 
when using a more flexible model, but the more flexible model was 
not implemented for real survey data in time for this release. We 
will explore improved modeling in detail for future DES analyses. 

We constructed the model in celestial coordinates and fit it 
to multiple epochs and bands simultaneously (cf. §7.1). The centre, 
size and ellipticity were set to be the same for all bands and epochs, 
but the flux was allowed to vary between bands. For this study we 
combined bands r, i, z, resulting in eight free parameters: 

• Uc, Vc, the object centre in celestial coordinates, relative to the 
fiducial centre from the coadd object catalogue. The units are arc- 
seconds. 

• ei, 62 , the ellipticity. 

• T, the area of the object, defined in terms of the unweighted 
moments of the Gaussian mixture T = (a;^) -|- The units are 
arcseconds squared. 

• Fk, the flux in each of the r, i, z bands. 


7.4.2 Image fitting 

The NGMIX code supports multiple paradigms, all of which were 
used in the current analysis: 

• Exploration of the full likelihood surface for a given set of 
model parameters with a Markov Chain Monte Carlo (MCMC) 
scheme, using either the standard Metropolis-Hastings algorithm 
(MH; Metropolis et al. 1953) or the recently introduced affine in¬ 
variant method (Goodman & Weare 2010; Foreman-Mackey et al. 
2013). The model can be fit directly to the pixel data, or it can in¬ 
clude convolution by a point-spread function (PSF). 

• Maximum-likelihood fitting using any of a variety of function 
minimizers. We used Levenberg-Marquardt (LM; Levenberg 1944; 
Marquardt 1963) as well as the method of Nelder & Mead (1965) 
(NM) in this work. The model can be fit directly to the pixel data, 
or it can include convolution by a PSF. 

• Expectation Maximization (EM; Dempster et al. 1977), fitting 
directly to the pixels only. This method is used for PSF fitting. 

For PSF measurement, the EM code was used, with three com¬ 
pletely free Gaussians. EM is a good choice for PSF measurement, 
since it is extremely stable even with many components. By allow¬ 
ing all components to be completely free, the off-centre PSF com¬ 
ponents that are occasionally found in the SV PSF images were 
fitted without instability. 
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We chose to handle the WCS information hy projecting each 
pixel into celestial coordinates and building both the galaxy and 
PSF models in that coordinate system. 

Our procedure for fitting the galaxy shapes involves a number 
of steps 2 * 

(i) Estimate a flux for the object by fitting the PSF model to the 
galaxy with a single free parameter, which is the overall normaliza¬ 
tion (keeping the centroid fixed at its fiducial value). 

(ii) Run NM to find the maximum likelihood model, guessing 
the flux from the result of step 1 , and guessing the size to be the 
typical seeing size. We find NM to be more robust than LM for this 
fit. 

(iii) Run LM starting from the maximum likelihood model to 
estimate the covariance matrix, since NM does not produce one. 
Relatively few evaluations are made in this step. 

(iv) Run an MCMC chain with MH using the maximum like¬ 
lihood position as a starting guess and the covariance matrix as 
a proposal distribution. We run a few thousand burn-in steps, fol¬ 
lowed by a few thousand post-burn-in evaluations. If the acceptance 
rate is outside the range [0.4,0.6] we reset the proposal distribution 
based on the covariance matrix from previous MH run, and run a 
new burn-in and post-burn in. If the acceptance rate remains out¬ 
side the desired range we try again up to four times. These bounds 
on the acceptance rate are somewhat arbitrary, but for our problem 
we found that rates above 0.6 result in highly correlated chains, and 
lower than 0.4 can result in a poorly sampled peak. 


7.4.3 Shear estimation 


Multiple methods are supported for shear measurement, but for this 
study we adopted the “LENSFIT”-style method, based on the work 
of Miller et al. (2007). We found our implementation of this method 
to be sufficiently accurate for the precision of our current data set; 
for this study NGMIX measurements were instead limited by the use 
of an overly simple exponential disc model for galaxies (cf. §8.5). 

The LENSFIT method involves multiplication by a prior on the 
distribution of galaxy ellipticities when estimating the expectation 
value of the ellipticity for each galaxy. 


^ J £(e)p(e)e^de 
/'C(e)p(e)de 


(7.8) 

(7.9) 


where £{e) is the likelihood and p(e) is the prior on the galaxy 
shapes. We approximate the integral over the likelihood with the 
sum of points from an MCMC chain. The index takes values 1,2 
for each ellipticity component such that e = (ei, 62 ); the ellipticity 
magnitude is given by e. 

Multiplying by an ellipticity prior reduces the effects of noise, 
which broadens and distorts the likelihood surface. However, appli¬ 
cation of the prior also biases the recovered shear, in effect reducing 
the “sensitivity” of the shear estimate. Miller et al. (2007) derive a 
measure of the sensitivity of this estimator to a shear g, which is 


We tried using the affine invariant fitter, and found it to be very robust, 
but the burn-in period was too slow for lai'ge-scale processing. This hybrid 
approach using both maximum-likelihood fitters and MH is significantly 
faster and sufficiently accurate. 


approximately given for each component by: 


dgrL 


~ 1 - 


~ 1 - 


J({e,)-e,)£(e)^de 


J £ie)p{e)de 

E,T(e^) 


(7.10) 


No expression was formally derived by Miller et al. (2007) 
for the mean of the shear field acting on an ensemble of galaxies; 
however, it was proposed to use the same formula as derived for a 
constant applied shear: 


5m 


Ei 


(7.11) 


where the index i runs over all galaxies in the measurement. In 
practice we also apply weights in both sums. 


1 

4“ ^1,1 4“ £' 2,2 


(7.12) 


where ctsn is the shape noise per component, which we have cal¬ 
culated to be 0.22 based on fits to COSMOS galaxies (cf. §7.4.4), 
and Cij are elements of the 2 x 2 ellipticity subset of the covariance 
matrix produced by NGMIX. 

The sensitivities in equation 7.10 do not transform as polar¬ 
izations. Thus for practical shear measurements, such as tangential 
shear or two-point functions, which require rotation of the elliptic¬ 
ities, we chose to use a scalar sensitivity for each galaxy that is the 
mean of its two components. 


7.4.4 Ellipticity prior 


The LENSFIT method requires as input a prior on the shapes of 
galaxies, p(e). The prior must be continuous for ei, 62 in the unit 
circle in order to evaluate the derivatives in equation 7.10. 

In simulations, we found that the accuracy of the shear recov¬ 
ery was sensitive to the details of the ellipticity prior. For example, 
we ran the shear code on the GREAT-DES simulation presented in 
§6.1 using a prior with intrinsic variance in ellipticity 35% higher 
than the true variance, and found the multiplicative bias increased 
by (1.3 ±0.2)%. 

For application to real data, we based our prior on the ellip¬ 
ticities of Sersic model fits to COSMOS galaxies, as released by 
the GREAT3 team (Mandelbaum et al. 2014). We fit the observed 
distribution to a simple model 


p(e) = 27reA 


(l±e)Ve^ + eo 


c(e) 


c(e) 


1 

2 


± erf 



(7.13) 

(7.14) 


This model is a modified version of that introduced in Miller et al. 
(2013). Note in particular the cutoff at high ellipticities achieved by 
using an error function. We found this formula improved the fit to 
the distribution of ellipticities. 

We fit this model to the ellipticities of COSMOS galaxies se¬ 
lected to fall in a range of size and flux that corresponds to the 
galaxy population seen in our data. A comparison between the mea¬ 
sured p{e) and the fit model is shown in Figure 14. The best-fitting 
parameters are given in Table 1. 

We used this same prior for all galaxies, but the distribution 
of COSMOS galaxy shapes depends on redshift. However, for this 
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Figure 14. Distribution of shapes for COSMOS galaxies, selected as de¬ 
scribed in the text. The model fit was used as a prior for the NGMIX shear 
analysis. 


Parameter 

Fit Value 

A 

0.025 

± 

0.002 

a 

2.0 

± 

0.2 

eo 

0.079 

± 

0.003 

^cut 

0.706 

± 

0.004 

O-e 

0.125 

± 

0.006 


Table 1. Parameters for the ellipticity prior used with the NGMIX shear 
code, with best-fitting values for the distribution of shapes of COSMOS 
galaxies. 


study we found that the uncertainties due to the redshift depen¬ 
dence of the shape distribution were sub-dominant to model bias 
for NGMIX (cf. §8.5). 


7.5 Blinding 

We blinded the shape catalogues from both pipelines before they 
were used for any tests or SV science papers. We did this to pre¬ 
vent the experimenter bias effect, wherein researchers work harder 
on finding bugs, tuning methodology, etc. when results are incon¬ 
sistent with a previous experiment, or otherwise do not match ex¬ 
pectations, than when they do match (cf. Klein & Roodman 2005). 

We blinded the SV shear catalogues by scaling all measured 
shears by a secret factor generated by an algorithmic, but unpre¬ 
dictable, process (using an MD5 hash of a code phrase) to be be¬ 
tween 0.9 and 1.0. This unknown scaling meant that it was harder 
for DES members to, for example, accidentally tune results to get 
the (Tg value predicted by Planck. We only unblined the catalogues 
after the analysis for a given paper was finalized. 

This was a gentle blinding approach that was appropriate for 
the relatively loose statistical constraints that will come from SV 
data. It has the useful feature that, being linear, correlation tests on 
it such as those listed in this paper remain valid. It has a significant 
downside in that it is asymmetric - unblinding could only increase 
the measured ag, so the potential for bias was still present. We will 
consider new blinding methodologies for future data. 


8 TESTS OF THE SHEAR MEASUREMENTS 

We developed an extensive test suite to check that the shear cat¬ 
alogues do not have significant systematic errors that would ad¬ 


versely affect weak lensing science. While there is no way to defi¬ 
nitely prove that the shear catalogues are free of all possible system¬ 
atic errors, there are many tests that can reveal systematic errors that 
might be present in the data. These tests were formulated as “null 
tests”, which should have zero signal in the absence of systematic 
errors. Most of our null tests were similar to ones that have been 
performed in previous analyses (cf. e.g. Jarvis et al. 2003; Schrab- 
back et al. 2010; Velander et al. 2011; Heymans et al. 2012b; fee 
et al. 2013; Kuijken et al. 2015). 

These null tests can be broken up into several broad categories. 

(i) Spatial tests to check for systematic errors that are connected 
to the physical structure of the camera. Examples of these are errors 
in the WCS correction, including effects like edge distortions or 
tree rings (Plazas et al. 2014), and errors related to features on the 
CCDs such as the tape bumps. (§8.1) 

(ii) PSF tests to check for systematic errors that are connected 
to the PSF correction. This includes errors due to inaccurate PSF 
modeling as well as leakage of the PSF shapes into the galaxy shape 
estimates. (§8.2) 

(iii) Galaxy property tests to check for errors in the shear mea¬ 
surement algorithm related to properties of the galaxy or its image. 
This can include effects of masking as well, which involve the other 
objects near the galaxy being measured. (§8.3) 

(iv) B-mode statistics to check for systematic errors that show 
up as a B-mode signal in the shear pattern. The gravitational lensing 
signal is expected to be essentially pure E-mode. Most systematic 
errors, in contrast, affect the E- and B-mode approximately equally, 
so the B-mode is a direct test of systematic errors. (§8.4) 

(v) Calibration tests to check for systematic errors that affect 
the overall calibration of the shears. If all of the shear values are 
scaled by a constant factor, most null tests remain zero (if they were 
zero to start with). Furthermore, there are no known absolute shear 
calibration sources that we can use to calibrate our results. For these 
reasons it can be hard to tease out errors in the calibration from the 
data. However, we can use simulated data where the true shear is 
known to check that we recover the correct values. (§8.5) 

(vi) Cross-catalogue comparisons to check that the two shear 
catalogues are consistent with each other. Because we have two 
shear catalogues available for testing, we can check that the two 
give consistent results, thus potentially uncovering problems that 
may be in one shear catalogue but not the other (or have differ¬ 
ent levels in each). Considering the large differences between the 
NGMIX and IM3shape codes, these are non-trivial tests. (§8.6) 


One caveat to keep in mind with the various null tests is that 
we do not necessarily expect the overall mean shear to be precisely 
zero. The S V region is small enough that the rms value of the mean 
shear due to cosmic variance is expected to be about 4 x In 

fact, the overall mean shear is measured to be 

(ei) = 0.1 X 10-* 

IM3SHAPE ; 

(62) = 6.8 X 10 

(ei) = -0.4 X 10“* 

NGMIX ^ 2 X 10-*. 


These values are both about 2a from zero given the expected cos¬ 
mic variance, so it may be due to an additive systematic error affect¬ 
ing both codes. However, the fact that they roughly agree with each 
other suggests at least the possibility that it could be a real cosmic 
shear signal. In any case, each of the null tests look for variations 
relative to this overall mean shear to find dependencies that may 
indicate systematic errors. 

In §8.1 - §8.6 we show the results of our null tests in each of 
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Figure 15. Whisker plots of the mean shear binned by position in the focal plane for IM3SHAPE (left) and NGMIX (right). As in Figure 9, the length of each 
whisker is proportional to the mean shear, and the orientation is aligned with the direction of the ellipticity. A 1 % whisker is shown for scale in the lower left. 


the above categories. In §8.7 we summarize these results and tries 
to quantify the total possible systematic errors that may be present 
in the shear catalogues. 


8.1 Spatial Tests 

There are many potential sources of systematic error related to the 
camera and telescope optics that can cause a spatial dependence of 
the shear with respect to the camera’s field of view. The telescope 
distortion pattern and some of the optical aberrations are essentially 
static in time. The CCDs have bad columns and other defects, in¬ 
cluding the tape bumps mentioned in §4.2. There are also distortion 
effects at the CCD edges due to the electric field lines becoming 
non-parallel as well as tree ring distortion patterns due to doping 
variations in the silicon (Plazas et al. 2014). 


8.1.1 Position in the field of view 

To check that we have adequately corrected for effects that are con¬ 
nected with the telescope and camera, or that they are small enough 
to ignore, we binned the shear spatially with respect to the field of 
view. 

In Figure 15 we show the mean shear as a function of position 
on the focal plane for both IMSshape (left) and NGMIX (right). 
Each whisker represents the mean shear of all galaxies that were 
ever observed in that area of the focal plane. As our shear measure¬ 
ments used information from multiple epochs, each measurement 
contributed to this plot multiple times: once for each single-epoch 
observation of that galaxy. 

This figure is similar to Figure 9, in which we showed the 
residual PSF pattern as a function of position on the focal plane. 
These plots are noisier due to the shape noise of the galaxies, but 
there is a hint of the same radial patterns that were seen for the PSF 
residuals, especially in the NGMIX results, which are slightly less 
noisy due to the higher number of galaxies in the catalogue. This is 
not surprising; we expected these PSF interpolation errors to leak 
into the galaxy shapes. 


8.1.2 Position on CCD 

If we bin the shears by their column number, irrespective of the 
CCD number, as shown in Figure 16, we can see the effect of some¬ 
thing known as “edge distortion” (Plazas et al. 2014). This is where 
the electric field lines in the detector become slightly non-parallel 
near the edges of the CCDs. The cross section of the pixels be¬ 
comes rectangular, elongated in the direction towards the edge of 
the CCD. Plazas et al. (2014, their Figure 6) showed that this effect 
led to photometric biases of ~ 20 mmag at ~ 30 pixels from the 
edge of the CCDs. Since flux and shape respond to the astromet¬ 
ric variation at the same order, this implies that we should expect 
shape residuals of about 5ei ~ 0.02 near the edge of the CCDs. 

In Figure 16 we show the mean shape measured by NGMIX 
binned by column number. As we do not measure the single-epoch 
shape, any effect on the shapes has been reduced by a factor of 
about 10, the number of single-epoch exposures of each galaxy. So 
we might expect a signal of (e) ~ 0.002. There does seem to be a 
slight effect visible in Figure 16 at this level for ei, although it is 
not highly significant. The effect of the edges is even less evident 
when binning by the row number (not shown). 

To quantify how much this edge effect might impact the over¬ 
all shear signal, we estimated that the effect is only significant 
for about 20 pixels on any edge. This is a fraction of 40/2048 -f 
40/4096 = 0.015 of the area. Galaxies have ~ 10 chances to fall in 
this area, so about 15% of the galaxies may have a spurious shear of 
~ 0.002. The net additive systematic shear from this effect is thus 
about Crms = 8 X 10“’’. This is well below the requirements on ad¬ 
ditive systematic errors given by equation 3.11, Crms < 2 x 10“^; 
however, it is not below the expected requirements for DES 5-year 
data. Therefore, we plan to remove this effect directly in the as¬ 
trometry solution in future DES data analyses. 

8.1.3 Tangential shear around field centres 

The telescope distortion pattern is approximately a fifth order ra¬ 
dial function centred near the centre of the field of view. If it is not 
corrected it can induce spurious shears oriented either radially or 
tangentially relative to the field centres. We looked for this effect 
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Figure 16. The mean shear (ei) (blue) and ( 62 ) (green) for NGMIX, binned 
by column number X; X runs along the readout rows of the CCDs. (The 
con'esponding plot for IM3shape looks similar but noisier.) The bottom 
panel shows the same data blown up near the left and right edges to highlight 
the effect of the edge distortion. We mask the 15 columns along each edge 
where the distortion is strongest, but there is still a slight bias in the ei 
component of the shears up to 40 pixels from the edge. 
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Figure 17. The tangential shear of galaxies in IM3shape (top) and NGMIX 
(bottom) around field centres. Both measurements are approximately con¬ 
sistent with zero, although at scales less than 10 arcminutes, both show a 
slight departure from the expected null signal. The magnitude of this effect 
is well below our requirements in both cases. 

by measuring the tangential shear pattern around the set of field 
centres; essentially this is similar to a galaxy-galaxy lensing mea¬ 
surement where the telescope pointings play the role of the lenses. 

In Figure 17 we show the results of this test for both the 
IM3shape and NGMIX shear measurement pipelines. Uncertain¬ 
ties are jackknife estimates, made by splitting the total area into 
152 equal-area sub-fields. At large scales, the measurements are 
consistent with zero, but at scales less than about 10 arcminutes 
there are a few consecutive bins with ~ Icr deviation from zero in 


both cases. The IM3SHAPE results show a slight oscillating pattern, 
and the NGMIX results are slightly negative (a radial shear pattern). 

None of these features is highly significant, especially since 
the points are somewhat correlated, so it may just be a noise fluc¬ 
tuation. Also, since the telescope distortion is largest at the edge of 
the field of view, we expected the absolute mis-estimation of the 
distortion to be largest at a separation of around 1 degree. Further¬ 
more, IM3 SHAPE and NGMIX use exactly the same WCS solution, 
since it is incorporated into the MEDS files directly. So the fact the 
tangential shear patterns are different in the two cases, and most 
significant near the centre, indicates that this is probably not due 
to errors in the WCS solution, although we do not have a good hy¬ 
pothesis for a plausible cause. 

We estimated the magnitude of this potential additive system¬ 
atic error in the same manner as we used above for the edge distor¬ 
tions. The mean spurious shear in this case has a magnitude of at 
most 0.005 in both cases and occurs over a relative area of about 
(2'/62')^ = 0.001. The net additive systematic shear from this ef¬ 
fect is thus at most Crms = 2 x 10“^, well below our requirements 
for an additive systematic shear. 

We also looked at the shear around the CCD comers. While 
there was a very slight hint of a non- zero signal at small scales, the 
magnitude was even smaller than the shear around the field centres. 

8.2 PSF Tests 

If the PSF interpolation is not sufficiently accurate or if the shear 
algorithm does not fully account for the effects of the PSF convo¬ 
lution, the resulting shear estimates will include a spurious additive 
error that is correlated with properties of the PSF. 

We looked for such additive errors by examining: (1) the mean 
shear binned by PSF ellipticity and PSF size, (2) the PSF-shear 
two-point correlation function and derived quantities, and (3) the 
tangential shear measured around stars. 

8.2.1 PSF leakage 

As we introduced in equation 3.4, we assumed that a component 
of the additive bias in the shear estimates comes from imperfect 
correction of the PSF, resulting in a term proportional to the PSF 
shape: 

Cgal = Ctrue OiCpSF + C. (8.1) 

A measured slope of galaxy ellipticity vs. PSF ellipticity can be 
identified as a, where we use the mean PSF shape over all epochs. 

The mean shear as a function of PSF ellipticity is shown in 
Figure 18 for both IM3SHAPE and NGMIX galaxies. The points rep¬ 
resent the mean galaxy ellipticity in each of 10 equal-number bins 
of PSF ellipticity. The line represents the best fit to the individual 
(unbinned) galaxy shapes. The slopes of the linear fits range from 
-2.0% to 5.7% ± 3% for IM3SHAPE and from -2.0% to 0.5% ±1% 
for NGMIX. The slopes are consistent with no PSF leakage for both 
catalogues. 

To obtain a more precise estimate of a, we computed the 
(weighted) average of the slopes of the red lines on the left plots 
(i.e. (ei) vs. PSF ei) and the blue lines on the right plots (i.e. (62) 
vs. PSF 62). For IM3shape we found a = 0.008 ± 0.025, and 
for NGMIX a = —0.001 ± 0.007. There is no evidence for non¬ 
zero a; however, for IM3shape, we cannot definitively confirm 
that |q| < 0.03 (cf. equation 3.15) given the uncertainty in the 
estimate. 
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Figure 18. The mean galaxy shear as a function of the input PSF elliptic- 
ity (ei left, and e 2 right) for IM3shape (top) and NGMIX (bottom). The 
solid lines show the best linear fit without binning. Note the range of the 
abscissa is different for the NGMIX and IM3shape plots. The NGMIX mea¬ 
surements are averaged over r, i, and 2 -band images, while the IM3shape 
measurements use r-band images, and different models are used for mea¬ 
suring the ellipticity, resulting in different PSF ellipticity ranges for the two 
catalogues. 


Figure 20. The calculation of the PSF leakage parameter a, which is given 
in equation 8.2. The top plots show (red), the cross correlation of the 
galaxy shapes with the PSF shapes, and ^pp (blue), the auto-correlation of 
the PSF shapes, for IM3shape (left) and NGMIX (right). The bottom plots 
show OL, which is a measure of the leakage of the PSF shapes into the galaxy 
shapes as a function of scale. The grey band shows the sample variance plus 
shape noise uncertainty for cx.. The is given for a over all scales. 
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Figure 19. The mean galaxy shear as a function of the input PSF size for 
IM3shape (top) and NGMIX (bottom). The solid lines show the best linear 
fit without binning. 


We similarly plot the mean shear as a function of PSF size 
in Figure 19 for both im3shape (left) and NGMIX (right). Linear 
best-fitting lines are also included. The slopes here are also consis¬ 
tent with zero, being on the order of 0.1% or less, which indicates 
negligible dependence of the mean shear on the PSF size. 


8.2.2 Star/galaxy cross-correlation 


Another estimate of the leakage factor a comes from the cross¬ 
correlation of the galaxy shapes with the PSF shapes, Writing 
in terms of equation 8.1 and solving for a, we find that 


Cf - (egai)‘(epsp) 
-KePSp)P 


( 8 . 2 ) 


where is the auto-correlation function of the PSF shapes, Cpsp. 

While this nominally gives us an estimate of a as a function 
of scale, a is not a scale-dependent quantity. It is a quantification 
of a point process, the possible leakage of the PSF shape into the 
galaxy shape estimates. Therefore, we expect this estimate of a to 
be consistent at all scales, given the uncertainties in the estimate. 

The measured and correlation functions are shown in 
the top panels of Figure 20 for IM3SHAPE (left) and NGMIX (right). 
a is then calculated based on these and shown in the lower pan¬ 
els. Due to sample variance, a can be non-zero in this test even 
if the measured shears have no PSF contamination. We used the 
mock catalogues described in Becker et al. (2015) to compute the 
total uncertainty for a. These catalogues were populated with PSF 
shapes by using the PSF shape from the nearest observed galaxy to 
each mock galaxy. We then used the full suite of 126 mock cata¬ 
logues to compute the total uncertainty on a including both shape 
noise and sample variance. 

We found that both IM3SHAPE and NGMIX show no signif¬ 
icant PSF contamination in this test, with a total x^/d.o.f. of 
18.3/25 and 22.3/25 for a computed over all scales. The best-fitting 
value for a in each case, properly taking into account the corre¬ 
lations (Avery 1996), is q = 0.010 ± 0.023 for IM3SHAPE and 
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Figure 21. Tangential shear around stars for IM3 shape (blue) and NGMIX 
(red). Stars are split into to two bins of i-band magnitude, where “bright” 
means 14 < mi < 18.3 and “faint” means 18.3 < mi < 22. The faint 
sample includes stars used for PSF modeling; bright stars are excluded to 
avoid the brighter-fatter effect (cf. §4.2). Shaded regions represent Itr shape 
noise uncertainty, while error bars are from jackknifing the stars. 

a = —0.008 ± 0.006 for NGMIX, both below the requirement of 
|a| < 0.03 from equation 3.15, although in the case of IM3SHAPE 
we are only able to constrain |a| to be less than 0.03 at about Icr. 

8.2.3 Tangential shear around stars 

If the PSF correction is incomplete, there may also be a residual 
signal seen in the mean tangential shear around stars, which could 
potentially contaminate galaxy-galaxy lensing studies. To test for 
this, we measured the tangential shear around the positions of stars 
in both IM3 shape and NGMIX for “bright” (14 < nii < 18.3) 
and “faint” (18.3 < rrii < 22) stellar populations. In all cases we 
found the signal, shown in Figure 21, to be consistent with zero. 
The shape noise uncertainty is shown as the shaded regions. The 
error bars are jackknife uncertainty estimates. 

The test using the faint stars primarily checks for effects re¬ 
lated to PSF interpolation and PSF modeling. The bright stars are 
not themselves used to constrain the PSF model (cf. Figure 6), so 
these stars instead check for problems related to deblending and 
sky estimation errors in the outskirts of bright stellar haloes. We 
see no evidence of any systematic errors around either set of stars. 

8.3 Galaxy Property Tests 

There are many properties of the galaxy images that should be in¬ 
dependent of the shear, but which in practice can be correlated with 
systematic errors in the shear measurement. For example, some of 
the properties we tested during the course of our analysis were: the 
size of the postage stamp, the number of neighbors being masked, 
the fraction of the stamp area being masked, the estimated bulge-to- 
disc ratio, the galaxy’s signal-to-noise, and the galaxy size. These 
were all extremely helpful diagnostic tools during the analysis, but 
here we only present the final two, which initially showed evidence 
of systematic errors and took the most effort to resolve. 

Using S/N oi the galaxy size for selections is quite natural, 
since estimating the shear for small, faint galaxies is more challeng- 



(5/W), 

Figure 22. The mean galaxy shear as a function of the signal-to-noise 
for IM3shape (top) and NGMIX (bottom). For IM3SHAPE we test against 
{S/N)ia (cf. equation 7.3), which is one of the parameters used for the cal¬ 
ibration, so it includes corrections for selection bias. For NGMIX, we test 
against {S/N)r (cf. equation 7.4), which does not induce any significant 
selection bias from the binning. 

ing than for large, bright galaxies. However, measurements of these 
quantities can be correlated with the galaxy ellipticity, and thus an 
applied shear. Binning the data for the null test by these properties 
can thus induce selection effects and produce a net mean spurious 
ellipticity. This was already discussed in §7.2 with respect to S/N. 
We need to do something similar to construct a proper null test for 
the galaxy size. 

8.3.1 Galaxy signal-to-noise 

The null test for checking that the galaxy shapes are independent 
of S/N requires different measures of S/N for each catalogue. 
As described in §7.3.2, for IM3SHAPE we calibrated the bias in the 
shear measurements from simulations as a function of {S/N).ui and 
Rgp/Rp. As such, the selection bias that is induced by binning on 
(5'/W)u, (cf. §7.2) is accounted for as part of the calibration. Thus, 
the appropriate null test on the data is to check that the mean shear 
is independent of {S/N)^,, as shown in the top panel of Figure 22 . 
There is no apparent bias in the mean shear down to {S/N)^ = 15. 

We did not apply any external calibration to NGMIX, so the 
null test for it requires a S/N measure that does not induce se¬ 
lection biases from the binning. For NGMIX, we used {S/N)r 
(cf. equation 7.4), which did not induce any selection biases when 
we tested it on simulated data. In the bottom panel of Figure 22 we 
show that the mean estimated shear for NGMIX is independent of 
this “roundified” signal-to-noise measure down to {S/N)r = 15. 

Previous versions of the NGMIX catalogue had shown a very 
significant bias in the lowest S/N bin in this plot before we realized 
that the bias was being induced by our galaxy selection from the 
cut on {S/N).ui. IM3shape calibrates this kind of selection bias, 
but when that calibration is faulty, it too could show a bias in the 
lowest S/N bin. In Figure 22 we show that the final catalogues do 
not have any such bias. The points are consistent with the mean 
value (which, as we mentioned, is not necessarily expected to be 
zero) and show maximal deviations less than our required Crms < 
2 X 10“^ (equation 3.11). 
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Figure 23. The mean galaxy shear as a function of the galaxy size for 
IM3shape (top) and NGMIX (bottom). For IM3SHAPE we test against 
Rgp/Rp, which is one of the parameters used for the calibration, so it 
includes comections for selection bias. For NGMIX, we test against a size 
measure, Tr (cf. equation 8.4), that does not induce and significant selec¬ 
tion bias from the binning. 


Figure 24. The measured B-mode for NGMIX (top) and IM3shape (bot¬ 
tom). Each band power measurement is plotted at its central location in 1. 
The grey band shows the uncertainty on the measurement due to both sam¬ 
ple variance and shape noise. Adjacent points are highly con'elated and the 
indicated yj accounts for the correlations. 


83.2 Galaxy size 


Similar considerations apply to the null tests for galaxy size. Since 
IM3shape corrects for selection bias using the measured Rgp/Rp, 
this is the appropriate quantity to use for the null test regarding 
galaxy size. In the top panel of Figure 23 we show the mean es¬ 
timated shear binned by Rgp/Rp. The IM3SHAPE measurements 
show no evidence of any dependence of the shear estimates on the 
size of the galaxy. 

For NGMIX, we need to use a size measure that is independent 
of the shape of the galaxy. The internal parameter that NGMIX uses 
for the size of the galaxy in its model is T = + lyy, the stan¬ 

dard second moment measure of the size of a galaxy; however, this 
quantity changes with applied shear. If a round galaxy is sheared 
by an area-preserving^® shear g, then the measured size will be 

y(9) = y(9=0) f 1 + Ifll ^ ^ (g 3, 

VI - \9\ J 


For non-round galaxies, an applied shear tends to make the 
estimated size T larger when the shear is aligned with the galaxy 
shape and smaller when it is anti-aligned. This can lead to an appar¬ 
ent bias in the measured shapes with respect to the measured value 
of T. If the mean PSF shape were precisely round, this bias should 
average out over an ensemble of galaxies; however, our PSFs have 
a preferred direction, which breaks the symmetry and leads to an 
apparent bias in the mean shape with respect to T. 

In parallel to our definition of {S/N)r as the signal-to-noise 
that the galaxy would have had if it were round, we similarly con¬ 
struct an estimate of the size that the galaxy would have had if it 
were round: 


Tr = T 


Vl + leP 


(8.4) 


By area-preserving, we mean that the determinant of the distortion ma¬ 


trix is unity: A = 




1-91 -92 

-92 1 + 91 


where e is the estimated shape of the galaxy. Binning the shears 
by this quantity should thus not induce any selection bias from the 
binning itself. In the lower panel of Figure 23 we show the results of 
this test for NGMIX. There is no apparent dependence of the mean 
shape on this “roundified” measure of the size of the galaxy. 

In both cases the slopes are consistent with zero and show 
maximal deviations well below our required Crms < 2 x 10“® 
(equation 3.1 1). 


8.4 B-mode Statistics 

The deflection field induced by gravitational lensing has the special 
property that it is essentially curl-free. Since this is also true of 
electric fields, the shear field is generally referred to as being an 
“E-mode” field. The corresponding divergence-free “B-mode” field 
can be considered as corresponding to an imaginary convergence 
(Schneider et al. 2002). 

In fact gravity can induce a slight B-mode from source clus¬ 
tering (Schneider et al. 2002), multiple deflections (Krause & Hi- 
rata 2010), and intrinsic alignments (Crittenden et al. 2001). But in 
practice all of these effects are well below the level at which we 
could measure them, which means that any significant measured 
B-mode is almost certainly a sign of uncorrected systematic errors 
in the shears. 

We calculated B-mode statistics of the shear field by comput¬ 
ing linear combinations of the binned shear two-point correlation 
function values that are insensitive to any E-mode signals, mod¬ 
ulo a very small amount of computable E- to B-mode leakage. 
See Becker (2013) for details. In this application, we chose lin¬ 
ear combinations that approximate band-powers in Fourier space 
as described in Becker & Rozo (2014). Finally, we used the mock 
catalogues described in Becker et al. (2015) to compute the shape 
noise and sample variance uncertainty for the statistics. These mock 
catalogues include the survey mask and match the shape noise and 
source photometric redshift distribution for each of the two shear 
catalogues. We used 126 mock catalogues in total. 

In Figure 24 we show the measured B-mode for each cata- 
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logue using the most conservative selection described below. Each 
band-power measurement is plotted at its central location in £. Ad¬ 
jacent points are highly correlated and the given in the figure 
accounts for the correlation. We find a x^/d.o.f. of 22.3/20 for NG- 
MIX and 16.1/20 for IM3SHAPE indicating no significant B-mode 
contamination in the shear field. 


8.5 Calibration Tests 

It is difficult to test the overall shear calibration using the data 
alone. However, we can use the GREAT-DES simulation described 
in §6.1 to test the performance of the two shear algorithms on rela¬ 
tively realistic images with known applied shear. 

Since IM3 SHAPE uses this simulation to calibrate the shear 
measurements (cf. §7.3.2), the overall corrected shears should be 
accurate, almost by construction. The calibration was done without 
weighting, but for this test we used the same weights that we rec¬ 
ommend for the data (cf. §7.3.4). The mean shear is thus not math¬ 
ematically guaranteed to be exactly zero. We detect a net bias after 
applying the calibrations, but it less than our requirements for DES 
SV data: mi = 0.0008 ± 0.0015 and m 2 = -0.0068 ± 0.0015. 

Eor NGMIX, the overall calibration error is a more relevant 
test. The priors used for GREAT-DES were the same as used for the 
DES SV data, which is expected to be appropriate given the general 
agreement between the galaxy properties in the simulation and the 
data (cf. §6.1). We found the overall calibration error for NGMIX to 
be mi = — 0.030±0.0015 and m 2 = —0.035±0.0015. This does 
not quite meet our requirement of |m| < 0.03 from equation 3.10. 

Considering that many science applications will use tomogra¬ 
phy to investigate the evolution of the shear signal with redshift, 
it is interesting to look at the calibration of both shear codes as 
a function of redshift. To test the redshift dependence of the bias, 
we used the known photometric redshifts of the galaxies from the 
COSMOS data, from which we drew the galaxy images used in the 
GREAT-DES simulation. With this test, we can also learn if the to¬ 
mographic selection process itself leads to any significant selection 
biases. 

In Eigure 25 we show the results of performing this test for 
NGMIX (top) and IM3shape (bottom), taking galaxies in different 
ranges of photometric redshift, using the same redshift bins that 
will be used for the cosmology constraints (The Dark Energy Sur¬ 
vey Collaboration et al. 2015). Note that the redshift information 
was not used in the calibration process for IM3 SHAPE, so the varia¬ 
tion with redshift is a non-trivial test of the correction. Prior to cal¬ 
ibration, we find a significant bias in each of the three redshift bins, 
m = (—0.039,-0.058,-0.072). After calibration (red circles, 
Eigure 25), the net multiplicative bias for IM3SHAPE is reduced to 
a level well within the requirements. This indicates that the derived 
corrections are robust to galaxy selections based on redshift. 

We also tested the performance of IM3shape’s PSE leakage 
calibration as a function of redshift (not shown). We found the 
overall leakage before calibration was a = (0.070, 0.112, 0.102) 
for the three redshift bins. After calibration, we found a = 
(0.001,0.021, —0.005), which demonstrates good performance of 
the leakage calibration as well. 

We found the multiplicative bias for NGMIX to be outside of 
the requirement band for the lowest redshift bin, and then rose to 
acceptable levels in the two higher bins. We believe this is be¬ 
cause the proportion of bulge galaxies is highest at low redshift, 
and the NGMIX exponential model has significant model bias for 
these galaxies. As the proportion of bulges decreases at higher red- 
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Figure 25. Multiplicative shear bias in three bins of photometric redshift for 
NGMIX (top) and IM3SHAPE (bottom), as calculated using the GREAT-DES 
simulation. In both cases, the same selection and weights were used as for 
the real data. The red circles denote the average bias in each bin after cor¬ 
recting for the sensitivity (NGMIX) or the calibration (IM3SHAPE). The blue 
triangles show an estimate of selection bias, calculated using the known true 
ellipticities. The grey band in both panels marks the ±3% requirement for 
SV data. 


shift, the mean model bias decreases, and the calibration is within 
our requirements. 

To test the hypothesis that we are measuring a model bias 
for the exponential disc model, we implemented a more flexible 
model and applied it to this simulation. This model is a simple 
two-component bulge and disc model, where the bulge fraction 
is determined not by a simultaneous fit with other parameters but 
by an initial comparison of two separate bulge and disc fits to the 
galaxy image. A similar model used in the Sloan Digital Sky Sur¬ 
vey for galaxy fluxes was known as the “composite” model (Abaza- 
jian et al. 2004). Eor the composite model we found biases ~ 1%, 
suggesting that the larger bias evident for the exponential model is 
principally model bias. Unfortunately, we were unable to apply this 
new composite model to the DES data in time to be used for this 
paper. 

The blue triangles in Figure 25 represent the estimated selec¬ 
tion bias in each bin induced by our various selection criteria. To 
calculate these values, we applied the known shear to the COSMOS 
shape estimates (Kannawadi et al. 2015) of the galaxies used for the 
simulation, and then applied the same selection criteria we used for 
each of the two algorithms. We found the selection bias from the 
IM3shape cuts was at most 2% in the highest redshift bin, which is 
largely corrected by the calibration scheme. We found the selection 
bias for NGMIX was less than 1% for all redshift bins. 


8.6 Cross-catalogue Comparisons 

Another powerful test is to compare the two independent shear cat¬ 
alogues, IM3shape and NGMIX. We used two very different strate¬ 
gies when generating these catalogues. For IM3SHAPE we used 
simulations to determine the shear calibration, and applied correc¬ 
tions to the shear measurements on real data. For NGMIX we ex¬ 
pected relatively little noise bias, but the sensitivity of the shear es¬ 
timator was calculated from the data itself and applied to the shear 
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measurements, a process that was worth testing in detail. And we 
did expect some model bias for NGMIX. Furthermore, the PSF was 
treated differently by the two methods: for IM3SHAPE we used the 
reconstructed PSF image directly, and for NGMIX we fit models to 
the PSF. 

A direct galaxy-by-galaxy test is not appropriate for a cross¬ 
catalogue comparison, since there is not a unique unbiased shear es¬ 
timate for a single galaxy. Rather, we wished to test that both meth¬ 
ods produced consistent shear statistics for an ensemble of galaxies 
(cf. Velander et al. 2011). Two potential shear statistics that can 
be used are a galaxy-galaxy lensing signal and the two-point shear 
correlation function. We tested if the results were consistent when 
using the same ensemble of galaxies with the same weighting. 

Disagreement between the catalogues would be proof that at 
least one catalogue is biased, but we would not be able to determine 
which one, nor the magnitude of this bias. Agreement between the 
two catalogues is subjectively reassuring, but we wish to emphasize 
that agreement does not prove that both catalogues are “correct” in 
the sense that they can be used to generate unbiased shear estimates. 


8.6.1 Tangential shear ratio 

Galaxy-galaxy lensing provides one of the cleanest tests of the rel¬ 
ative calibration of the two catalogues, because the azimuthal sym¬ 
metry inherent in the tangential shear signal largely cancels most 
sources of additive systematic error. Thus the ratio of two tangen¬ 
tial shear signals is primarily a measure of the relative multiplica¬ 
tive errors between the two catalogues. 

For this test, we used the tangential shear signal around Lu¬ 
minous Red Galaxies (LRGs) as determined by redMaGiC (red se¬ 
quence Matched-filter Galaxies Catalogue; Rozo et al. 2015) from 
the same DES SPT-E data. Eor this purpose, we did not require 
sources to be behind the lenses. Rather, we took the full ERG cat¬ 
alogue as the lenses, and for the sources, we used all galaxies that 
were well-measured by both NGMIX and IM3SHAPE. Regardless 
of the redshifts of the LRGs and the source galaxies, we expected 
the signal to be the same for both catalogues in the absence of a 
multiplicative bias. 

The observed signal {et,i{0)) for each method i G 
(IM3shape, NGMIX} can be written as; 

(er,i(6»)) = (1 -b mi){'yt{e)) + (?7*(0)), (8.5) 

where (jt) is the trae underlying signal, (rji) is a noise term in¬ 
cluding both intrinsic shape noise and measurement noise, and rrii 
is a possible calibration error for each method. We mostly drop the 
argument 9 in the following for brevity. For the same ensemble of 
galaxies, the two catalogues have identical values of (jt) and a sim¬ 
ilar shape noise contribution to (pi) (though not identical, since the 
two methods use different bands). The contribution to (rji) from 
shape measurement noise, however, is expected to be somewhat 
different. 

The red points in Figure 26 represent the ratio of measured 
tangential shear using the two shear catalogues. The weighted 
mean of the ratio over the range from 1 to 20 arcminutes (the 
typical scales of interest for weak lensing) is 0.932 ± 0.018. We 
would naively expect this to be an estimate of (1 -|- mNGMix)/(l + 
m,„3sHAPE) « 1 -b rriNGMix — miM3sHAPE. Flowever, three corrections 
are required before any conclusions can be drawn from this result 
about potential differences in the relative calibration. 

First, additive systematic errors only cancel if the sources are 
distributed uniformly around the lenses. This is approximately true, 
but masking can break the symmetry, especially at large scales. One 
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Figure 26. The ratios of tangential shear measurements around LRG galax¬ 
ies from shears measured by NGMIX to those measured by IM3SHAPE. The 
red circles show the direct ratio and the triangles correspond to the ratio af¬ 
ter subtraction of the tangential shear around random points. The weighted 
mean ratio in the scale range 1 — 20 arcminutes is 0.954 ± 0.018. The 
blue line shows a prediction of the ratio (0.94) based on the GREAT-DES 
simulation, which accounts for a selection bias induced by the intersection 
of the two shape catalogues. This result is in good agreement with the data 
points. 


solution is to subtract off the measured tangential shear around ran¬ 
dom points, drawn from the same region and with the same mask¬ 
ing as the LRGs. No signal is expected around such points, but any 
additive bias will affect both measurements equally. Thus the dif¬ 
ference is a cleaner estimate of the true tangential shear than the 
uncorrected signal. The blue points in Figure 26 represent the sig¬ 
nal after this subtraction, and have a mean ratio of 0.954 ± 0.018, 
Second, the ratio of two noisy quantities with the same mean 
does not in general have an expectation value equal to 1. If the de¬ 
nominator is a random variable, X, with a symmetric probability 
distribution (e.g. X ~ Af{X, ax)), the ratio will be approximately 
1 -b ax /X^ .To account for this bias, we created simulated realiza¬ 
tions of the ratio, and compared the measured signal to the mean 
and variance of these. We generated a ratio realization in the fol¬ 
lowing way: 

(i) Fit a polynomial, log((et)(0)) =p(log(0)) to the measured 
NGMIX signal, and take this to be the true signal, 

(ii) For each source in the ensemble, rotate both the NGMIX and 
IM3shape shear by the same random angle. 

(iii) Re-measure the two tangential shear signals, which now 
give estimates of the noise, {rf (9)), as the true signal is removed 
by the random rotations. 

(iv) Compute the realization ratio as 

(T^ “b (l?NGMIx))/(Tt “b (r)|M3SHAPE))- (8.6) 

We found the mean of these realizations to be consistent with a 
ratio of 1 on all scales, which means that the S/Nof the tangen¬ 
tial shear is high enough that we can neglect the noise term in the 
denominator. 

Finally, we found that the act of matching the two catalogues 
caused a selection bias in the NGMIX catalogue, for two reasons. 
First, the IM3SHAPE algorithm failed more often for objects with 
low Sersic index (n < 1). And second, the cuts we made on the 
IM3shape measurements of (S'/Wju, and Rgp/Rp altered the mix 
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COSMOS Photometric Redshift 

Figure 27. Multiplicative bias for NGMIX shear measurements on GREAT- 
DES simulated data as a function of redshift. The red circles show the bias 
calculated using all galaxies that pass the NGMIX selection criteria (as in 
the upper panel of in Figure 25). The blue triangles show the bias when 
also including the recommended IM3shape selection, as we do to obtain 
the matched catalogue used for Figure 26. As in Figure 25, the grey band 
represents the ±3% requirement for the SV data. 


of galaxy properties in the matched catalogue. These two selection 
effects, when applied to the NGMIX catalogue imparted a net bias 
on the NGMIX shear estimates in the matched catalogue that was 
not present in the full NGMIX catalogue. 

We quantified the level of this selection bias by performing the 
same procedure on the GREAT-DES simulation. We compared the 
mean bias for NGMIX using the canonical NGMIX selection criteria 
to the bias after applying the IM3SHAPE selection, as a function of 
redshift. The result is shown in Eigure 27. The matching induced 
a mean selection bias of about —3%. Furthermore, we found that 
this bias increased with redshift. Weighting the bias according to 
the lens redshift distribution and the lensing efficiency of the source 
galaxies used in the tangential shear ratio test (and assuming that 
the lenses do not evolve with redshift), we found a net selection bias 
of —6% for NGMIX in the matched catalogue relative to whatever 
bias might be present in the full NGMIX catalogue^®. 

The mean ratio of 0.954 ± 0.018 is thus consistent with the 
prediction from GREAT-DES of —6% selection bias (which would 
produce a ratio of 0.94). This bias induced by the combination of 
IM3shape and NGMIX selection criteria in the matched shape cat¬ 
alogues is shown by the blue line in Figure 26. Our finding is there¬ 
fore consistent with no relative multiplicative bias between the two 
catalogues. 

We cannot of course prove that neither catalogue is affected 
by a significant multiplicative bias based on this test. They could 
both be biased by the same amount in either direction. Furthermore, 
there are significant uncertainties in the calculation of the predicted 
selection bias described above that may be at the ~ 3% level. 


We tested for a similar selection bias in the IM3shape catalogue due to 
imposition of the NGMIX cuts. The impact of the matching was found to be 
negligible, in part because the NGMIX catalogue is deeper, so its cuts have 
very little impact on the IM3SHAPE selection. 


8.6.2 Differential shear correlations 

The two-point shear correlation function is much more sensitive to 
additive shear errors than the tangential shear, as mentioned above; 
it would be difficult to disentangle multiplicative and additive er¬ 
rors in a ratio test. Even in the absence of additive errors, the ratio 
of shear correlation functions is much noisier than the ratio of tan¬ 
gential shears, making it a less stringent test of calibration. 

For these reasons, we instead use the two point function of the 
difference in the shear estimates from NGMIX and IM3SHAPE to 
compare the shear catalogues: 

^+,Ae(^) = {(CnGMIx(x) eiM3SHAPE(x)) 

(Cngmix(x -¥ 0) — 6im3shape(x -T 0))). (8.7) 

Consider the following model for the additive systematic er¬ 
rors in each catalogue (labelled i here): 

O-i (1 UjCcommon 4“ G, (8.8) 

where mi is the calibration error, r)i is the noise in the estimate, 
Ccommon includes any additive systematic errors present in both cat¬ 
alogues, possibly multiplied by different coefficients Ui, and a is 
the additive error particular to each catalogue. 

By constmction, the additive bias terms in equation 8.8 are 
independent. If we further make the assumption that the systematic 
errors are uncorrelated with the applied shear and the noise, and 
that m and c are uncorrelated, we find that 

i+Md) = (Am)"C+(e) 

+ (Aaf( 

'^common^common) (^) 

(^ngmixCngmix) (^) 

(C]m3shapeCim3shape ){e). (8.9) 

This test is sensitive to the spatial correlations of the systematic 
errors in either catalogue, but particularly to additive errors, rather 
than multiplicative. The [Amf factor for the multiplicative term 
typically makes this term insignificant. 

There is one subtlety in the construction of this test. As we 
found in §8.6.1, the act of matching the two catalogues can induce 
selection biases that are not present in either catalogue separately 
when using its own individual selection criteria. In this case, the 
salient selection effects are a spurious PSF leakage a and an overall 
mean (c) that can be induced by the match. 

The estimated value of a for NGMIX changed by less than 
0.1% in the matched catalogue relative to the full NGMIX cata¬ 
logue. But for IM3shape, the matching changed a by —1.5%. 
Therefore, to make this a fair test of the additive systematic er¬ 
rors, we added back 0.015 x Cpse to the IM3SHAPE galaxy shapes 
to account for this selection effect.^^ 

Even after correcting for the above effect, we found that the 
mean shear changed by (3.9 + 2.2i) x 10“"^ for NGMIX and by 
(2.0 — 3.0i) X 10“"^ for IM3SHAPE. We interpreted these changes 
as due to selection biases from the matching itself, leading to a 
spurious overall (c) for each catalogue. We thus subtracted these 
values as well from the shape estimates in each catalogue. 

In Figure 28 we show the resulting correlation function (equa¬ 
tion 8.7) after subtracting these selection biases. For the weights, 
we used w = v/'R'ngmix x Wimsshape- The yellow band represents 
our requirement for additive systematic errors from equation 3.12. 

We also subtracted the corresponding value for NGMIX, although it 
makes no discernible difference. 


MNRAS 000, D37 (2015) 


















30 M. Jarvis, E. Sheldon, J. Zuntz, T. Kacprzak, S. Bridle, et al. 


Test 

Upper Limit on Systematic Error 



im3shape 

NGMIX 


PSF Model Tests 




§4.2 Mean PSF size error 

\m\ < 0.005 

|m| < 0.01 


§4.4 PSF model diagnostics pi, 3,4 

(1') < 2 X 10-®t 

?“(!') < 5 X 10-® 



(30') < 7 X 10“® 

(30') < 9 X 10-® 


§4.4 PSF model diagnostics p 2,5 

^“(1') < 2 X 10-'^ 

^^"(1') < 8 X 10-® 



(30') < 1.5 X 10-'^ 

(30') < 1.4 X 10-''' 


Spatial Tests 




§8.1.1 Position in the field of view 

No evidence of systematic errors 

No evidence of systematic 

errors 

§8.1.2 Position on CCD 

^^'^(l') < 6 X 10-''' 

(1') < 6 X 10-'^ 


§8.1.3 Tangential shear around field centres 

^“(1') < 4 X 10“® 

( 1 ') < 4 X 10 -® 


PSF Tests 




§8.2.1 PSF leakage 

|a| < 0.04 

|q| < 0.01 


§8.2.1 Dependence on PSF size 

No evidence of systematic errors 

No evidence of systematic 

errors 

§8.2.2 Star-galaxy cross correlation 

|a| < 0.03 

|a| < 0.015 


§8.2.3 Tangential shear around stars 

No evidence of systematic errors 

No evidence of systematic 

en'ors 

Galaxy Property Tests 




§8.3.1 Galaxy S/N 

No evidence of systematic errors 

No evidence of systematic 

en'ors 

§8.3.2 Galaxy size 

No evidence of systematic errors 

No evidence of systematic 

errors 

B-mode Statistics 




§8.4£2CBB(f)/27r 

No evidence of B-mode 

No evidence of B-mode 


Calibration Tests 




§8.5 Redshift dependence in GREAT-DES 

\m\ < 0.02 

\m\ < 0.04 


Cross-catalogue Comparison 




§8.6.1 Tangential shear ratio 

|Am| < 0.04 


§8.6.2 Differential shear correlations 


(l')| < 9 X 10-® 




(30')| < 2 X 10-''' 



t Since IM3shape use only the r-band images, the values quoted here are based on the p statistics measured for the r-band-only PSFs. These curves are a bit 
higher than what is shown in Figure 10, which uses r, i, ^ bands. 


Table!. Summary of the results of our suite of null tests (including tests in §4.4). For reference, our nominal requirements from §3 are |a| < 0.03, \ m\ < 0.03, 
(!') < 7 X 10“®, and ^((.‘'(30') < 2.5 X 10“^. 



Figure 28. The shear auto-correlation function of the difference in shear 
estimates of NGMIX and IM3shape. This test shows the level of additive 
systematic en'ors that may still be present in one catalogue that is not present 
in the other. The yellow band is the requirement, from Figure 3. 


We see that, at scales less than 3 arcminutes, we do not quite meet 
the requirements. Either one or both catalogues apparently have 
non-negligible additive systematic errors at these scales. We rec¬ 
ommend that science applications sensitive to additive systematic 
errors check carefully how these small-scale systematic errors may 
affect their science results. 


8.7 Summary of Systematics Tests 

We now attempt to synthesize the results of our large suite of null 
tests. With this many tests, even if all the tests pass individually, it 
would not necessarily imply that the total systematic error is below 
our requirements. In this section we attempt to quantify an upper 
limit on the level of systematic error that may be in the shear cata¬ 
logues, given all of the information we have available. 

In Table 2 we provide a summary of the results from the previ¬ 
ous sections (including the tests in §4). For each, we have converted 
the result of the test into the impact that the result could have on 4 
possible values. For PSF leakage, we give the maximum allowed 
value of a. For other kinds of additive systematic errors, we give 
the maximum value of ^“(0) ai 8 = 1 arcminute and (when rel¬ 
evant) 30 arcminutes. And for multiplicative errors, we give the 
maximum |m| that is consistent with the test. Some tests do not 
lend themselves to a quantitative upper limit. Fortunately, in each 
of these cases, there is no evidence from the test that there is any 
systematic error. 

There are two tests that give constraints on the PSF leakage 
coefficient a. In all cases, the tests are completely consistent with 
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a = 0. However, given the uncertainties in each case, we think 
it is appropriate to take the upper limit from the star-galaxy cor¬ 
relation function estimate, since it is the more precise estimate in 
both cases. This gives us limits of a < 0.03 for IM3SHAPE and 
a < 0.015 for NGMIX. We can multiply this by Cf 1° give a limit 
on the maximum additive systematic error we may have at 1' and 
30' due to PSF leakage. 

For the other additive systematic errors, we can add them to¬ 
gether linearly. ^ acts like a variance, so systematic uncertainties 
add linearly, not in quadrature. However, the differential shear cor¬ 
relation test is different from the others. It includes many of the 
additive systematic errors tested by other tests, and in particular 
would almost certainly incorporate any systematic error due to PSF 
leakage, as the mechanism for any such leakage would be different 
for the two algorithms. Thus, it actually places a tighter limit on the 
potential systematic error from PSF leakage at 30' than the direct 
estimate of a. 

The differential shear correlation does not however include all 
of the additive errors from the PSF model tests. The two codes use 
the same PSF model for the r-band exposures, although NGMIX 
also uses i and a-bands. We conservatively assume that the PSF 
modeling systematic errors act as Ccommon terms in the nomencla¬ 
ture of §8.6.2 and add them to the estimate from the differential 
shear correlation to get our final estimate on the possible additive 
systematic error in each catalogue: 


im3shape 

NGMIX 


C^"(l')| < 1.1 X 10“'^ 
^5'"(30')| < 4 X 10“’’ 
< 1-4 X 

^5'"(30')| < 4 X lO”’’. 


( 8 . 10 ) 

( 8 . 11 ) 


Note that we are not claiming that either catalogue has systematic 
errors as large as this. Rather, we are claiming at ~ la level of 
confidence that the additive systematic errors in the two catalogues 
are smaller than this. 

The limits on the multiplicative systematic errors come from 
two sources. We have estimated the bias on simulated data, and we 
have measured the relative bias of the two catalogues with respect 
to each other. With the exception of the lowest redshift bin for NG¬ 
MIX, where we found a bias of m ~ —0.04, all of the tests are 
consistent with |m| < 0.02 for both catalogues. 

Investigation of the low redshift result for NGMIX indicates 
that it is largely due to that bin having more bulge galaxies than the 
higher-redshift bins, leading to increased model bias there. How¬ 
ever, Figure 12 shows that the distribution of bulges in GREAT- 
DES may not match the data very well, in particular as a function 
of S/N, which is correlated with redshift. This makes us uncertain 
how applicable the m = —0.04 result is to the SV data. 

Furthermore, while the tangential shear ratio test showed that 
the two catalogues were consistent to within \Am\ < 0.02, this 
was only after correcting for a matching-induced selection effect of 
Am ~ 0.06. This correction involves a number of assumptions, so 
we are not confident that it is more precise than about ±0.03. 

For these reasons, we feel that an appropriate upper limit on 
m for both catalogues is 


|m| < 0.05. 


( 8 . 12 ) 


9 SHEAR CATALOGUES 

The final shear catalogues are publicly available on the DESDM 
Releases web page^^. See that web page for complete documenta¬ 
tion about how to access these catalogues, as well as the other DES 
SV catalogues that are available. 

In this section we describe the final galaxy selection, how to 
correctly apply the calibrations and sensitivities to ensembles of 
galaxies, and what final number density we achieve. Appendix B 
has further details about the content and structure of the catalogues. 


9.1 Einal Galaxy Selection 

The starting point for our galaxy catalogues was described in §2.1 
and §2.2. The former described how we selected regions of the sur¬ 
vey where we trust the images, and the latter described our initial 
galaxy selection function. We now describe further cuts informed 
by the suite of null tests in §8, such that the final shear catalogues 
were found to pass our tests. 

We removed individual objects according to the following cri¬ 
teria: 


• SExtractor flags = 1 or 2. Objects with higher SEx- 
TRACTOR flags were already been removed from the input cat¬ 
alogues, since they are clearly problematic for a shape measure¬ 
ment code. But these two flags indicate that the object is likely to 
be blended, and thus the shape measurement was likely to be cor¬ 
rupted. 

• “Crazy colours”^^. Individual objects with questionable 
colours are probably contaminated by cosmic rays or other defects, 
so their shapes are also likely to be inaccurate. 

• Very low surface brightness. We found a class of spurious ob¬ 
jects with very large sizes, but relatively low flux that were usu¬ 
ally associated with various image artefacts. We excluded objects 
with i ± 3.51og(/i/T) < 28, where fi is the i-band flux, and 
T = Ixx ± lyy is the (deconvolved) object size estimated by NG¬ 
MIX. This cut is efficient at bright fluxes, but less so at faint fluxes, 
removing a significant number of real galaxies. 

• Tiny size. If the NGMIX estimate of the object size is very 
small, then the object is probably a star. Specifically, we removed 
objects with T ± ctt < 0.02 square arcseconds. 


From the resulting set of “good galaxies”, we then made a 
further selection based on both S/N and the size of the galaxy 
relative to the PSF size, such that the resulting ensembles of shear 
estimates passed the null tests. 

As we have already mentioned in §7.3.2, the IM3SHAPE selec¬ 
tion needs to be made using {S/N)y^ and Rgp/Rp, since these are 
the parameters used for the shear calibration. NGMIX does not do 
any calibration, so its selection is made using {S/N)r and Tr/Tpsp 
(cf. equations 7.4 & 8.4) to avoid inducing a selection bias. 

The selection that we find passes the suite of null tests is the 
following: 


IM3shape : 

NGMIX : 


(S/N)^ > 15 
Rgp/Rp > 1.2 

{S/N)r > 15 
Tr/Tpsp > 0.15. 


We used this selection for all of the test results shown in §8. 


We recommend science applications that are sensitive to multi¬ 
plicative bias marginalize over a Bayesian prior on m centred at 
0 with a standard deviation of 0.05. 


http ; //des . ncsa . Illinois . edu/releases/sval 
“Crazy colours” mean any of the following: g — r < —1, g — r > 
4, i — z < —1, or i — 2 > 4 
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shear. This will apply the appropriate correction to the subset of the 
galaxies that fall into each bin. 

The correction method is slightly more complicated for two- 
point correlation functions, since each product involves two correc¬ 
tion factors. In this case, the proper estimate is 




Y^wtw){et - c°:){e) - c)) 




(9.3) 


The denominator is just the two-point function of the scalar num¬ 
bers s“ and s^. The ratio is then taken for each bin in 6. 


9.3 Effective Number Density 

The effective number density of a weak lensing survey is defined 
implicitly in terms of the expected variance of either component of 
the estimated mean shear over its solid angle Q. (Chang et al. 2013): 


Figure 29. A histogram of the r-band magnitude distribution showing the 
application of the various selection criteria from the initial “Gold” Cata¬ 
logue to the two final shear catalogues. The dark red and blue show the 
galaxies with sufficiently accurate shape for NGMIX and IM3 shape respec¬ 
tively. 


In Figure 29 we show the effect that successively applying 
each round of selections has on the distribution of r-band magni¬ 
tudes, starting with the original Gold Catalogue, selecting possi¬ 
ble galaxies, removing problematic galaxies, and then applying the 
S/N and size criteria for the two shear catalogues. 


9.2 Applying the Calibration/Sensitivity 


For both IM3SHAPE and NGMIX, the raw galaxy shape values 
given in the catalogue are intrinsically biased estimators of the 
shear. In the case of IM3SHAPE, simulation-based calibration is 
used (cf. §7.3.2). For NGMIX, the expectation value of the ellip- 
ticity was estimated from the posterior likelihood surface with a 
centrally-concentrated prior applied, which reduces the sensitivity 
of the estimator to an applied shear. An estimate of this sensitivity 
was calculated and given in the catalogue (cf. §7.4.3). 

In both cases, the correction factor is a noisy estimate of the 
true correction. It is therefore not advisable to correct each galaxy’s 
shape by the corresponding correction factor directly as this will 
introduce a bias. Rather the mean shear of an ensemble of galaxies 
should be corrected by the mean of the correction factors: 


E(ei -cQ 


(9.1) 


where a is the additive correction for IM3SHAPE {d = 0 for NG¬ 
MIX) and Si is the multiplicative correction 1 -|- m for IM3SHAPE 
or the estimated sensitivity for NGMIX. 

The corrections in both cases are accurate in the limit of large 
numbers of galaxies. In practice, the ensemble should contain at 
least hundreds to thousands of galaxies to avoid dividing by noisy 
estimates of the mean sensitivity or shear bias correction. 

In addition, each catalogue comes with a recommended 
weight Wi to use for making these ensemble averages: 


, , ^ Ywi{ei-Ci) 
YWiSi 


(9.2) 


For statistics such as tangential shear, you would apply the 
correction separately in each bin where you are computing a mean 


var((7i,2)) 



flrieff ’ 


(9.4) 


where (Tsn is the shape noise per component. 

Applying all of the selections defined in §9.1 to our shape cat¬ 
alogues results in 2.12 million galaxies for IM3SHAPE and 3.44 
million galaxies for NGMIX. The total useable area of SPTE is fl = 
139 square degrees (cf. §2.1), which leads to direct number densi¬ 
ties of 4.2 and 6.9 galaxies per square arcminute respectively. 

To turn these numbers into proper effective number densities, 
we first need to calculate the shape noise ctIn- 


2 

<^SN 


Ewf (|eiP - 2cre,i) 


(9.5) 


where 2al is the trace of the covariance matrix of 61 , 62 ^^, and 
the 2 in the denominator is to match the standard convention of 
quoting shape noise per component. As described above, Si is the 
calibration factor or sensitivity correction for the two catalogues. 
For the IM3SHAPE catalogue, this number comes to ctsn = 0.233, 
and for NGMIX, csn = 0.243. 

The variance of each component of the mean shear over the 
entire survey area can be calculated from equation 9.2: 


2/22 1 2 \ 

var(( 7 i, 2 )) - ' 2 U 

[YwiSi] 

(9.6) 

which, using equations 9.4 & 9.5, leads to 


1 ^SN (X] 

(9.7) 

1 {Y'^i^if (, '2‘Y'^i'^e,i\ 

Ywhl V Ew'lleilV 

(9.8) 


For IM3shape, we find ries = 3.7 galaxies per square arcminute, 
and for NGMIX, riefr = 5.7 galaxies per square arcminute. 

Note that other authors use different definitions of rieff than 
this. For instance, Heymans et al. (2012b) uses the definition 






(9.9) 


Using this definition we obtain rieff = 4.1 and 6.8 for IM3SHAPE 


IM3shape does not produce a useful estimate of the covaiiance matrix, 
so we instead estimate cr^ from the weights, which are designed to be an 
estimate of l/jcsf, + (cf. §7.3.4). 
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and NGMIX, respectively. With this definition however, the appro¬ 
priate numerator in the ratio cr^ /ries is not the intrinsic shape noise 
(JsN, but rather the total shear noise including measurement noise. 
For our data, the values to use would be CTe = 0.245 for IMSshape 
and Ge = 0.265 for NGMIX. 

These number densities are quite a bit below the 10 galaxies 
per square arcminute that was predicted for DES (The Dark Energy 
Survey Collaboration 2005). This is in part because of our deci¬ 
sion to cut both catalogues at S/N > 15 rather than 10 as we 
had originally hoped to be able to do. This removed about 0.5 mil¬ 
lion galaxies from the IMSshape catalogue and 1.0 million from 
the NGMIX catalogue. Moving the IMSshape size cut down to 
Rgp/Rp > 1.15 as well would add another 0.8 million galaxies. 
We hope that algorithm improvements to both catalogues will make 
these looser selection criteria possible in future DES analyses. 

Furthermore, the average depth of the SV survey was not the 
full ~10 exposures we expect for DES after five years. Instead, 
the mean is approximately 7 exposures averaged across the SPT-E 
area. If we reach an average of 10 exposures. This will lead to a 
20% increase in the mean S/N and a corresponding increase in the 
number of usable galaxies. 

In addition, the predicted value was based on an expected me¬ 
dian seeing of 0.9”, while the median seeing during science verifi¬ 
cation was slightly above 1.0”. We are closer to achieving our goal 
of 0.9” in the main survey observations (Diehl et al. 2014), so this 
will help to increase rieff. 

Another reason for the low number count is the rejection of 
objects with neighbors. The SEXTRACTOR flags related to blended 
objects removed almost 1 million galaxies from the catalogues. 
We are currently working on an algorithm to model the profiles 
of neighboring objects so their light profiles can be effectively re¬ 
moved from the image and not contaminate the shapes of nearby 
objects, thus allowing us to keep more of these objects in the cata¬ 
logue. 

Another obvious improvement will be to use multi-band fitting 
in IMSshape, which would increase the S/N of each galaxy by 
using more pixels of information. This is already implemented, but 
it was not complete in time to be run and tested on these data. It 
will be used in the next DES analysis. 

Einally, the detection of image artefacts in the data manage¬ 
ment pipeline has been improved from the version used for the SV 
data. The removal of low surface brightness objects, which was de¬ 
signed to remove a large proportion of these artefacts, removed 1.5 
million objects. Presumably many of these are real galaxies rather 
than image artefacts, so if we can omit this step, we will keep more 
galaxies in the catalogue. 

With all of these improvements to both the data and the algo¬ 
rithms, we are optimistic that we will be able achieve our forecasted 
Ueff — 10 galaxies per square arcminute in the 5-year DES analysis. 


10 SUMMARY AND DISCUSSION 

We present here two shear catalogues for the SPT-E region ob¬ 
served as part of the DES science verification time. Both cata¬ 
logues, NGMIX and IMSshape, have passed a comprehensive suite 
of null tests that show that they are accurate enough to be used for 
weak lensing science with these data. The catalogues have 4.2 and 
6.9 galaxies per square arcminute (for IM3SHAPE and NGMIX re¬ 
spectively), which corresponds to 2.12 and 3.44 million galaxies 
over the 139 square degree footprint. These correspond to effec¬ 


tive number densities of 3.7 and 5.7 galaxies per square arcminute, 
respectively (cf. §9.3). 

Eor creation of both shear catalogues we used the original 
single-epoch pixel data to jointly constrain the galaxy models, 
thereby avoiding issues of correlated noise and complex PSF inter¬ 
polation that occur when using stacked images. This is a relatively 
new technique in weak lensing, having only previously been em¬ 
ployed on real data by Heymans et al. (2012b) and Kuijken et al. 
(2015). 

In addition to passing null tests on the data individually, the 
two catalogues are consistent with each other, both in terms of pos¬ 
sible additive systematic errors and the overall calibration (i.e. mul¬ 
tiplicative systematic errors). This is a non-trivial result, consider¬ 
ing that the calibration strategies of the two catalogues are com¬ 
pletely different; IM3SHAPE calibrates the shear bias from simula¬ 
tions, and NGMIX uses a Bayesian algorithm that is relatively in¬ 
sensitive to noise bias, but does require a prior on the ellipticity 
distribution. This is the first significant weak lensing analysis to 
present two accurate and independent shear catalogues, and thus 
the first to be able to show this kind of consistency. 

In §8.7 we estimated upper limits on the level of additive 
systematic errors that may be present in the two catalogues at 1' 
and 30'. We recommend a Bayesian prior of \m\ < 0.05 for 
the systematic uncertainty on the calibration for both catalogues. 
Since NGMIX is the deeper catalogue (due to using multi-band data 
rather than just r band), users desiring the most precise measure¬ 
ment may adopt NGMIX as their canonical shear catalogue. How¬ 
ever, we strongly recommend also comparing with results using the 
IM3shape catalogue, while carefully taking into account any se¬ 
lection effects; any discrepancy indicates a systematic error in one 
or both catalogues. 

While the catalogues were seen to be sufficiently accurate for 
SV weak lensing science, they do not yet pass the tests at the level 
that will be needed for the full 5-year DES data. There is still a 
significant amount of work required to improve the algorithms to 
meet those requirements. 

One area that needs improvement is our PSE modeling 
(cf. Eigures 6 & 10). Eortunately, there has been a significant 
amount of work in recent years on improved PSE modeling and in¬ 
terpolation algorithms (e.g. Chang et al. 2012; Li et al. 2012; Kitch- 
ing et al. 2013; Gentile et al. 2013). We have also been working on 
an algorithm to model the PSE using the actual optical aberrations 
measured from the wavefront sensors in the corners of the DECam 
field of view (Roodman et al. 2014). We will investigate whether 
incorporating this information can lead to more accurate PSE inter¬ 
polation. 

We also expect a significant improvement in the astrometric 
solution in the next round of analysis. It will include a more accu¬ 
rate functional form for the telescope distortion and also take into 
account effects like edge distortions and tree rings that are present 
in the data (cf. Figure 16). We expect this to reduce some of the 
spurious features seen in Figures 9 & 17. 

We have recently implemented an algorithmic correction to 
the brighter-fatter relation discussed in §4.2 (Gruen et al. 2015). 
This will allow us to use brighter stars for constraining the PSF 
than we were able to use in this analysis, which is expected to lead 
to better estimated PSFs. 

We are working on an improved algorithm for handling neigh¬ 
bors by subtracting off an estimate of their light profile rather than 
merely masking contaminated pixels. While not a perfect subtrac¬ 
tion, we expect this will let us use more pixels for constraining the 
galaxy models, which will lead to fewer galaxies being removed 
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from the final catalogues. Contamination by neighbors was one of 
the more significant cuts that led to the drop in number density for 
the “good galaxies” seen in Figure 29. 

There are also two new shear algorithms being developed for 
DBS. One is based on the Bayesian Fourier domain (BFD) algo¬ 
rithm of Bernstein & Armstrong (2014). The other is based on the 
MetaCalibration strategy, a preliminary version of which was tested 
in the GRBAT3 challenge (Mandelbaum et al. 2015). Considering 
how useful we found it to have two catalogues, we are looking for¬ 
ward to the prospect of additional catalogues to compare in various 
ways. 

We also plan to begin implementing corrections for the chro¬ 
matic effects of the PSF described by Meyers & Burchat (2015). 
According to their estimates of the effects of PSF chromaticity, it is 
not expected to be a significant problem for the current analysis, but 
we will need to correct for these effects in the 5-year data analysis. 

In addition to these planned algorithmic improvements, the 
data itself will be somewhat better in the main survey. Part of the 
reason for taking the science verification data was to find problems 
with the camera and telescope hardware. As such, quite a few hard¬ 
ware improvements were made during this time, as well as some in 
the following year (cf. Diehl et al. 2014). The image quality for the 
main survey is thus significantly better than the already quite good 
image quality in the SV data. 

We therefore believe that we will be able to significantly im¬ 
prove the quality of the shear catalogues in future DBS analyses. 
We must keep the level of systematic errors below the improved 
statistical uncertainty for these data. The full 5-year DBS data will 
cover about 30 times more area, so our requirements for the sys¬ 
tematic errors will drop by roughly a factor of 5. By implementing 
the improvements discussed here, we hope to keep pace with the 
requirements. 
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APPENDIX A: Multi-Epoch Data Structures 

Each MEDS file corresponds to a single coadd image. Eor each 
one, we gather the list of all single-epoch images that were used 
to construct the coadd image. Then for each object in the corre¬ 
sponding coadd detection catalogue, we identify the location of the 
object in all single-epoch images where that object appears using 
each image’s WCS transformation to convert between the coordi¬ 
nate systems. We then identify a region around each object in each 
single-epoch image and save it as a postage stamp in the MEDS 
file. A postage stamp from the coadd image is also stored in the file 
as the first entry for each object. 

The size of the cutout is determined from the basic SEx- 
TRACTOR measurements flux_radius, a_world and b_world 


as follows: 


s = 2x5x(jx(l + e) 

(Al) 

cr = FWHM//ac 

(A2) 

FWHM = 2 X flux_radios 

(A3) 

e = 1 — b_world/a_world, 

(A4) 


where fac ~ 2.35 is the conversion between FWHM and a. The 
FLUX_RADIUS is a robustly measured quantity, being the radius of 
the circular aperture enclosing half the estimated total flux of the 
object. We find that a_world and b_world, while not suitable for 
a lensing shear analysis, are measured well enough for the purpose 
of estimating the eccentricity e. 

We take the maximum of the size s from all single-epoch mea¬ 
surements as the fiducial cutout size. To facilitate fast EFT calcula¬ 
tions on the cutouts, we round the fiducial cutout sizes upward to 
either a power of two or 3 times a power of two. 

In addition to the image cutouts, we also store the SEx- 
TRACTOR weight map and segmentation map. The cutouts are 
background subtracted using the background maps output by SEx- 
TRACTOR. The weight maps are modified to be zero anywhere that 
a flag is set in the SEXTRACTOR maskplane, which includes de¬ 
fects such as bad pixels. The different image types are stored in 
separate extensions of the file, along with a plethora of metadata. 

All images, including the coadd image, are placed on the same 
photometric system such that the magnitude zero point is 30.0. The 
weight maps are also scaled appropriately. 

Because the full set of data to be stored in the MEDS file does 
not fit into memory simultaneously, we use the ability of CFIT- 
SIO^® to write chunks of images directly to disk without keeping 
the full image in main memory. 

The code for creating MEDS files, including the WCS trans¬ 
formation library, is hosted publicly as part of a larger package 

http : //heasarc . gsfc . nasa . gov/fitsio/fitsio.html 


Value 

Decimal 

Meaning 

2" 

1 

IM3shape failed completely. 

2l 

2 

Minimizer failed to converge. 

2^ 

4 

Tiny ellipticty |e| < 10“"^: IM3 shape fit 
failed. 

2^ 

8 

ei or 62 outside (—1,1). 

2^ 

16 

Radius > 20 ai'cseconds. 

2^ 

32 

Rgp/Rp > 6 - huge galaxy. 

2® 

64 

Negative or nan Rgp/Rp. 

2^ 

128 

(S'/N)™ < 1. 

2® 

256 

per effective pixel > 3. 

2® 

512 

Normed residuals < —20 somewhere. 

2i0 

1024 

Normed residuals > 20 somewhere. 

2“ 

2048 

6u more than 10 arcseconds from nominal. 

212 

4096 

Sv more than 10 arcseconds from nominal. 

213 

8192 

Failed to measure the FWHM of PSF or 
galaxy. 

214 

16384 

r-band SEXTRACTOR flag has 0x4 or above. 

230 

1073741824 

No attempt at a fit was made due to cuts prior 
to mnning im3shape. 


Table Bl. Error flags in the IM3SHAPE catalogue. Objects with non-zero 
ERROR_FLAG should be removed from any science analysis. 

deswl_shapelets^®. The code that generates the input object list, 
including cutout sizes, is part of the meds software library. 

The MEDS data, including all of the images of each object 
observed in a single coadd tile, along with appropriate catalogue 
information, are stored in a single FITS file. 

To simplify access to the data in the MEDS filess, we provide 
an Application Programmer’s Interface (API) library, meds, which 
is available for download^^ and is free software. A full API is pro¬ 
vided for the Python language. A smaller subset of the full func¬ 
tionality is available as a library for the C programming language. 
For complete documentation of the meds file structure and the API 
for reading these files, we direct the reader to the meds repository 
URL. 

APPENDIX B: DETAILS OE THE SHEAR CATALOGUES 
BI im3shape Elags 

IM3shape reports two kinds of flags. Table Bl lists “error” flags, 
and Table B2 lists “info” flags. For the most conservative treatment, 
users should select galaxies where both are zero. However, using 
INF0_FLAG > 0 may be appropriate in some cases. 

B2 NGMix Flags 

The NGMIX catalogue has an error flag that indicate when some 
kind of error occurred during the fitting procedure. Users should 
only use galaxies with error_flag == 0 . The meanings of the 
various possible error flag values are given in Table B3. 

B3 File Structure 

There are three files available on the DESDM SVAl Release web 
page^® containing the final DES SV shear catalogues: 

https : //github . com/rmjarvis/deswl_shapelets 

https ; / / github . com/esheIdon/meds 

http ; //des . ncsa . illinois . edu/releases/sval 
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Value 

Decimal 

Meaning 

2“ 

1 

r-band SEXTRACTOR flagged with 0x1, indi¬ 
cating bright neigbours. 

2l 

2 

r-band SEXTRACTOR flagged with 0x2, indi¬ 
cating blending. 

2^ 

4 

Mask fraction >0.5. 

2^ 

8 

Model image < —0.01 somewhere. 

2'^ 

16 

RgvIRv < 1-15- 

2^ 

32 

Radius > 5 arcseconds. 

2® 

64 

Centroid more than 0.6 arcseconds from nomi¬ 
nal. 

2'’ 

128 

per effective pixel > 1.25. 

2® 

256 

Rgp/Rp > 3.5 (very large galaxy). 

29 

512 

Normed residuals < — 2 somewhere. 

2l0 

1024 

Normed residuals > 2 somewhere. 

2“ 

2048 

Declination below limit where we have good 
photometry. 

212 

4096 

(S/N)^ > 10®. 

213 

8192 

Radius > 10 arcseconds. 

214 

16384 

(S/N)^ < 10. 

215 

32768 

Model image < —0.05 somewhere. 

216 

65536 

X^ per effective pixel < 0.8. 

217 

131072 

More than 70% of fitted flux is in masked region. 

218 

262144 

Model completely negative. 

219 

524288 

X^ per effective pixel > 2. 

220 

1048576 

PSF FWHM > 10 arcsec. 

221 

2097152 

Negative PSF FWHM. 

222 

4194304 

Rgp/Rp < 1-1. 

223 

8388608 

Centroid more than one arcsecond from nomi¬ 
nal. 

224 

16777216 

Mask fraction > 0.75. 

225 

33554432 

One or more error flags is set. 


Table B2. Info flags in the IM3SHAPE catalogue. Objects with non-zero 
INFO_FLAG may be acceptable depending on the scientific application. 


Value 

Decimal 

Meaning 

2® 

1 

There were no cutouts for this object. 

2l 

2 

PSF fitting failed for all epochs. 

2^ 

4 

Not used. 

2® 

8 

Galaxy fitting failed. 

2* 

16 

Box size was larger than 2048. 

2® 

32 

Not used. 

2® 

64 

The {S/N)w of the PSF flux was lower than 

4 in all bands. 

27 

128 

Utter failure of the fitting. For this release, 
the flag was set when no valid guess for the 
fitters could be generated. 

2® 

256 

Not used. 

29 

512 

No attempt was made for round measures be¬ 
cause of prior failure. 

2l0 

1024 

Round model could not be evaluated within 
the allowed region of parameter space. 

2“ 

2048 

Fitting failed when trying to estimate S/N 
of Tr. 

230 

1073741824 

No attempt of a fit was made due to other 
flags. 


Table B3. Error flag values in the NGMIX catalogue. Objects with non-zero 
ERROR_FLAG should be removed from any science analysis. 


Column 

Meaning 

COADD_OBJECTS_ID 

A unique id number of the object. 

E_1 

The raw ei shape estimate. 

E_2 

The raw 62 shape estimate. 

NBC_M 

The multiplicative bias correction. 

NBC_Ci 

(2 E {1,2}) The additive bias corrections. 

W 

The recommended weight. 

ERROR_FLAG 

The error flag (cf. Table B1 in Ap¬ 
pendix Bl). 

INFO_FLAG 

The info flag (cf. Table B2 in Appendix B 1). 

SNR_W 

The estimated (S/N)w 

SNR_R 

The estimated (S/N)r. 

MEAN_RGPP_RP 

The mean value of Rgp/Rp among the dif¬ 
ferent observations of the galaxy. 


Table B4. The most relevant columns in the IM3 shape catalogue. Addi¬ 
tional columns included in the catalogues are described in the documenta¬ 
tion on the release web page. 

• sval_gold_rl. I_im3shape . f its . gz is the IM3SHAPE 
catalogue. The relevant columns in this catalogue are listed in Ta¬ 
ble B4. 

• sval_gold_r 1. 0_ngmix . f its . gz is the NGMIX catalogue. 
The relevant columns in this catalogue are listed in Table B5 

• sval_gold_rl. 0_wlinfo . fits has flags that can be used 
to select a set of galaxies with good shear estimates. It also has 
columns with information from the main coadd catalogue, such 
as RA and Declination, for convenience in using these catalogues 
without having to join them to the main DES object catalogue. 
Photometric redshift information is based on the SkyNet algorithm 
(Sanchez et al. 2014; Bonnett 2015; Bonnett et al. 2015). The 
columns in this catalogue are listed in Table B6. 

In addition to these three weak lensing files, the SVAl release 
includes files for the Gold Catalogue, limiting magnitude maps, the 
good-region footprint, photo-z catalogues (including both point es¬ 
timates and full PDFs) (Bonnett et al. 2015), redMaPPer cluster 
catalogues (Rykoff et al. 2016), and redMaGiC galaxy catalogues 
(Rozo et al. 2015). See the release documentation page for more 
details about these other files. 

Most users will want to select objects where svai_flag == 0 . 
This selects the objects that we are confident are actually galaxies, 
and not either stars or some kind of spurious artefact in the data. See 
Table B7 for the meaning of non-zero values of this flag. In addition 
we have two additional columns that indicate which galaxies fail 
the IMSshape and NGMIX selection criteria. The im3SHAPE_flag 
column is zero if 

(ERROR_FLAG==0) & {INFO_FLAG==0) & 

(SNR_W>15) & (MEAN_RGPP_RP>1.2) 

The NGMIX_FLAG column is zero if 

(ERROR_FLAG==0) & {0.4<ARATE<0.6) & 

(SENS_1>0.0) & (SENS_2>0.0) & 

(SNR_R>15) & (T_R/MEAN_PSF_T>0.15) 

In each case, these select the galaxies which have been found 
to pass all of the null tests in §8. Users can thus select galaxies with 
good shear estimates by simply selecting im3SHAPE_flag==0 or 
NGMIX_FLAG==0 as appropriate. 

This paper has been typeset from a TgX/RTjiX file prepai'ed by the author. 
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Column 

Meaning 

COADD_OBJECTS_ID 

A unique id number of the object. 

E_1 

The raw ei shape estimate. 

E_2 

The raw 62 shape estimate. 

SENS_AVG 

The average of the two sensitivity estimates. 

W 

The recommended weight. 

E_C0V_O' 

{i,jG {1,2)) The covariance matrix of the 
shape estimate. 

ERROR_FLAG 

The error flag (cf. Table B3 in Ap¬ 
pendix B2). 

SNR_W 

The estimated {S/N)w 

SNR_R 

The estimated {S/N)r- 

T 

An estimate of the size, T, in arcsec^. 

T_R 

An estimate of the size, T, that the object 
would have had if it were round. 

MEAN_PSF_T 

The mean measured size, T, of the PSF for 
the different exposures that went into the 
shear estimates for this galaxy. 

ARATE 

Acceptance rate of the MCMC chain. 

Table B5. The most relevant columns in the NGMIX catalogue. Additional 

columns included in the catalogues are described in the documentation on 
the release web page. 

Column 

Meaning 

COADD_OBJECTS_ID 

A unique id number of the object 

RA 

The right ascension of the object in degrees 

DEC 

The declination of the object in degrees 

iyiAG_AUTO_G 

The p-band magnitude 

MAG_AUTO_R 

The r-band magnitude 

MAG_AUTO_I 

The 2 -band magnitude 

iyiAG_AUTO_Z 

The 2 -band magnitude 

PHOTOZ_BIN 

The cosmological photometric redshift bin 
(0,1,2) as described in The Dark Energy 
Survey Collaboration et al. (2015) 

MEAN_PHOTOZ 

A point estimate of the photometric redshift 
from the SkyNet photo-z catalogue (Bon¬ 
net! et al. 2015) 

SVA1_FLAG 

A flag indicating problematic galaxies 
(cf. Table B7) 

IM3SHAPE_FLAG 

A flag that is 0 if this object’s shape in the 
IM3 shape catalogue is good to use; 1 if 
not. 

NGMIX_FLAG 

A flag that is 0 if this object’s shape in the 
NGMIX catalogue is good to use; 1 if not. 


Value 

Decimal 

Meaning 

2^ 

1 

2 -band SEXTRACTOR flag has bit 0x1 set, indicat¬ 
ing bright neighbors. 

2 l 

2 

2 -band SEXTRACTOR flag has bit 0x2 set, indicat¬ 
ing blending. 

2 ^ 

4 

Modest Classification calls this object a star 
(bright_test or locus_test from §2.2). 

2 ^ 

8 

Modest Classification calls this object junk 

(faint_psf_test from §2.2). 

2 ^ 

16 

In region with high density of objects with “crazy 
colours” (i.e. any of the following: g — r < —1, 
g — r > A, i — z < —1, or i — z > 4). 

2 ® 

32 

In region with a high density of objects with large 
centroid shifts between bandpasses. 

2 ® 

64 

Near a 2MASS star with Jm < 12. The mask ra¬ 
dius is flux dependent, up to 120 arcmin for the 
brightest stars. 

2 ^ 

128 

Large offset in g and i band windowed positions. 

28 

256 

Object was not measured by NGMIX. 

29 

512 

Likely star according to NGMIX T + ctt < 0.02 
square arcseconds. 

2 l0 

1024 

Very low surface brightness according to NGMIX 
measurements. 

2 “ 

2048 

Object does not satisfy good measurement flags in 
NGMIX. 

212 

4096 

Object does not have a valid magnitude in all 
g,r,i,z bands. (That is, at least one of them is in¬ 
valid.) 


Table B7. Values of the SVA1_FLAG in the info catalogue 


Table B6. The columns in the info catalogue. 
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